NISHIO Hirokazu[English][日本語]

Azure Tech Day ~March 2024 Edition~

Azure Tech Day March 2024 Edition - MICUG

Microsoft intends to use AI technology not only in Azure cloud services, but also in all its products and services, including Microsoft 365. The company is moving from the phase of touching on a function-by-function basis to the implementation and development phase. The use of AI is an extension of DX, and it is inefficient to think of AI completely in isolation; the system integration, data integration, security, governance, etc. aimed for in DX are also important foundations for advancing AI.

  • Requires deliberate daily practice
  • Microsoft's analysis of feedback from 10,000 prior users of Copilot for Microsoft 365 found that "deliberate daily practice is necessary.
  • To get used to interacting with AI, it is important to practice continuously with a clear intention, not just to use it vaguely.
  • There are tricks to successfully utilizing AI assistants such as ChatGPT.
    • Clear and specific instructions need to be given for better results
    • It is also important to understand the capabilities and limitations of AI before requesting appropriate tasks.
  • These skills are not acquired overnight.
    • That's why it's important to be intentional, even if it's just a little bit at a time, to build up your practice every day.
    • Gradually become accustomed to interacting with AI and learn how to use it more effectively and productively
  • I don't want to work without an AI assistant
  • Enable every individual and organization on the planet to achieve more When promoting AI projects, it is advisable to first think of DX results and company data and systems, then apply AI functions to narrow down the themes with high business impact. It is inefficient to solicit ideas from all employees.

People who say, "Data utilization is a challenge," and "What happens when the challenge is solved?" cannot answer the question "What happens if the issue is solved?

  • Lack of a clear image of the issue
  • Effort is being put into clarifying the story here. - PRO Model だなnishio.icon - They think it's a "Problem," and the Remedy and Outcome are not clear.
  • affinity with collaboration layer.

The value that AI brings.

Company deploying company-wide chat AI with no updates since then.

  • Usage rates will drop, there is a
  • Would you be given a chat box to discuss your own work?
    • Accustomed to searching for 20 years, never had "consultation" with computer, need training

Roundtable discussion with companies that have increased sales

  • Same as in the early days of the cloud

    • Are you sure you want to use it?"
    • "Will they learn what I type?" If I copy and paste the output, won't I be accused of copyright infringement or plagiarism?"
    • Insecurity prevents them from using it.

  • Companies that have done well have used rules and guidelines

    • Disclaimer is important, not throwing out long-form rules.
    • The drumbeat is, "If this is how you want to use it, don't worry about it."
    • Rules for clarifying what you are allowed to do

  • Monitoring.

    • I'm measuring how much better by what metric.
    • Company-wide functions are not recommended.
      • Specific tasks should be pinpointed and shot.
      • Easier to measure effectiveness and appeal
      • Happy with chat on the infamous system.

  • AI chat is a user interface revolution that allows users to take advantage of technology without programming knowledge

  • Cybercrime is the world's third largest economy Criminals also use AI, and win because AI is stronger.

  • In terms of AI security, attackers are also utilizing AI, so the defenders need to be able to use AI well. It is important for the defenders to have a lot of information and be ready to grasp and respond in real time. AI is also being incorporated into security products such as Microsoft Defender to enhance SOAR-like automation and analysis. Automatic generation of queries, automatic creation of incident reports, etc. are now possible.

  • Do not create tables with pre-determined field items

  • graph database. ransomware

  • Cloud is DXed and details are known, which is a defensive advantage

  • On-premises has holes because of omissions of grasp, which is advantageous to the attacker

  • OSINT: equal Human Parity

  • Triage of incidents

Industrial Metaverse

Human speed vs.

  • We can input data much faster than humans.

Copilot out in Edge and YouTube summary

KMS Corporation

  • The problem of a sharp decrease in the use of internal ChatGPT

  • gamification

    • As if people are making AI for the fun of it.

  • KBS is a game company, but it is using AI and cloud computing to efficiently perform high-load service operations with a small workforce. The company faces challenges in securing manpower and specialized personnel.

  • AI is used in various aspects of game development. Image rough creation, scenario checking, debugging, user data analysis, and automated response to inquiries. AI is also used in the back office to streamline recruitment interviews and support personnel evaluations.

  • At first, the implementation of AI was frustrating. The usage rate dropped because they did not know how to use it. Therefore, the company developed an in-house system and gamified AI to make it more familiar to employees, thereby successfully changing their mindset.

  • For the demonstration, we created an AI that recommends kitchen cars coming near our office. By tuning the data and configuring the AI's behavior in detail, we created an AI that can have natural conversations.

  • He also showed that by applying game characterization to AI, it is possible to create a friendly and engaging AI assistant.

  • By controlling AI appropriately and devising data and settings, it can be applied to a wide variety of applications. A culture has been created in which employees spontaneously create AI to improve operational efficiency.

  • The gaming industry is also facing a serious shortage of human resources, and the company aims to improve operational efficiency and alleviate the shortage of human resources through the use of AI. After much trial and error, AI is beginning to permeate the company.

  • AI is not difficult, and we want to make it accessible to everyone. He encouraged people to experience AI at the booths at the seminar.

It is important to let them enter through play.

  • Suddenly, "We have to create something useful for our business" is a high hurdle.
  • Same as "how to make people pay" for games.
    • We need to lower the hurdles and let them experience it first.
  • First, make something to play with.
    • I'll use it for fun.
    • Some people who use it for fun will ask, "How does it work?" There are people who become
  • Show how it works, surprisingly easy to make.
    • If you make it, you'll want others to use it.
      • viral marketing
  • As you make them for fun, you'll be able to construct mental models that will be beneficial to your work.
    • For example, creating a recruiting email
      • The play bots and the mechanics are the same.
    • There is a lot of technical terminology, etc., in engineering recruiting, so there is difficulty in including that information in a draft for someone without technical knowledge.

Microsoft Fabric

  • Microsoft Fabric provides a single SaaS service that delivers the analytics capabilities needed by the enterprise. From the data lake to the business user, they can work and leverage in one place.
  • [Building a Data Lakehouse｜Databricks https://www.databricks.com/jp/resources/ebook/building-the-data-lakehouse?scid=7018Y000001Fi15QAC&utm_ medium=paid+search&utm_source=google&utm_campaign=17367027484&utm_adgroup=139781182920&utm_content=ebook&utm_offer=building-the- data-lakehouse&utm_ad=665996192349&utm_term=databricks&gad_source=1&gclid=CjwKCAjw5ImwBhBtEiwAFHDZx1fsCEgX_k03iZAiueZZ7iI9N5L_ VOXMebt_crSCWeJeUMzvGlsKkxoCu04QAvD_BwE]
  • Parquet | Databricks
  • Fabric features include a complete analytical infrastructure, one-lake, one-copy data sharing, friendly UI, integration with Microsoft365, and co-pilot.
  • Yamashita, a welfare equipment rental company, is promoting DX with the goal of tripling sales by 2030. One of the pillars of this is the democratization of data utilization.
  • As the importance of data utilization grows, the ever-evolving Microsoft Fabric is a strong option. GEAL offers a menu of fabric experience workshops, validation, and implementation support.
  • In data utilization, it is essential to proceed steadily with a series of quick wins and realize the effects, rather than starting on a large scale out of the blue. It is desirable to proceed with a skilled supporter.

Microsoft offers a designated engineering menu as part of Unified Support. This allows Microsoft engineers to directly assist users with their AI projects.

  • Creating a copilot requires Azure OpenAI Service, Azure AI Studio, development tools, Microsoft Fabric, and application infrastructure. AI orchestration plays a central role.
  • When creating a copilot, a wide range of skills are required, including basic knowledge of rags and prompts, knowledge of models and services, index design, security design, reliability design, and prompt engineering.
  • Microsoft solution architects will support user co-pilot development through upskilling assistance, AI infusions, hackathons, and security reviews of infrastructure aspects.
  • Co-pilot development requires different skills and knowledge than traditional application development. Solution architects' know-how can be utilized to make the process more efficient.
  • Assistance by a solution architect is highly sought after and demand is expected to increase. Early consideration and consultation is recommended.

Provisioned Throughput Unit

[From "mono-seller" to platformer: DX realized in a year and a half by a manufacturer in Kagawa: "Ambidextrous DX" despite lack of cloud talent - ITmedia Enterprise https://www.itmedia.co.jp/ enterprise/articles/2311/27/news002.html] Sewer equipment manufacturer Ishigaki develops "myoru" to monitor, predict and control equipment from a smartphone - DIGITAL X (Digital Cross) Started using "myoruGPT Powered by ChatGPT" | Ishigaki Corporation Based on user requests, cloud service developed in Azure for remote monitoring combining IoT and sewer equipment - Cloud Watch Ishigaki Corporation Begins Using "myoruGPT Powered by ChatGPT" | Ishigaki Corporation Press Release claude.iconIshigaki has developed a remote monitoring cloud service called miyoru, which combines IoT and sewer equipment using Microsoft Azure. The main points can be summarized as follows

  • Ishigaki is a leading company in sewer equipment, and around 2020 began full-fledged efforts to promote DX.
    • Mr. Ishigaki is a manufacturer active in the water infrastructure field in Kagawa Prefecture. He is a group company with about 2,000 employees.
  • In 2021, started developing the "miyoru" cloud service, which allows users to remotely check the operating status of automated submersible pumps from their smartphones by attaching IoT sensors to them.
    • Around 2021, he began to get involved with Microsoft and conducted an assessment. My impression of Microsoft has changed dramatically.
    • MYORU was developed with the support of Microsoft Azure. The goal was to solve the customer's issues while consolidating the opinions of each department.
  • Guerrilla IoT efforts began in 2015. Despite some internal opposition, the company began considering full-scale cloud services in 2021.
    • Open Data from the Ministry of Land, Infrastructure, Transport and Tourism
    • Raspberry Pi
  • The high productivity of easy Azure parts made it possible to develop MYORU in just one year. Development was accelerated through remote meetings, etc.
    • FTA (technical assistance)
      • Four months of development
      • Assessment results confirmed the cost benefits of Azure migration. Utilizing Fast Track for Azure as well, Miyoru developed the cloud service "Miyoru" in just four months.
  • MIYORU was first shown at the Sewerage Exhibition in August 2022. It attracted a great deal of attention from customers.
    • Miyoru is a platform that uses AI to provide insight into the water environment. There is a plan to use AI for after-sales service for machinery manufacturers, such as proposing renewal of aging pumps.
    • Through participation in exhibitions, Miyoru became a member of the product lineup. The company received inquiries from overseas and became a platform for the group.
    • Ishigaki aims to create new business value through miyoru by utilizing IoT and data. The company hopes to contribute to solving issues in the water environment.
  • Employees became attached to the name Miyoru, and various ideas began to emerge from within the company.
  • In August 2023, the company will begin using miyoruGPT for employees, using Azure OpenAI Service to improve internal productivity. As described above, Ishigaki is an advanced case of DX in the manufacturing industry. The company is unique in that it took customer needs as its starting point and combined its strengths with the cloud to create a new service in a short period of time.

LIFULL Providing the real estate industry's first "service for general users using generative AI" and achieving a high level of stability and security by adopting Azure OpenAI Service Beautiful search results on Bing. Prompt flow

  • Rifle established the Generative AI Product Development Office in May 2023, releasing four products using OpenAI products to first try to make something anyway.

  • The first two products used the OpenAI platform. We struggled to achieve the designed user experience and provide a stable service.

  • Later, they realized that Azure OpenAI Service was easy to use and implemented it starting with the third product. The abundance of cloud services and the Prompt Flow enabled a large amount of trial and error.

  • The latest work was developed with Azure OpenAI in collaboration with Nomura Real Estate Solutions. We were able to take advantage of Azure's benefits in terms of stability and security.

  • Azure OpenAI addresses privacy protection and overseas relocation challenges; AI content safety features provide tamper protection.

  • Azure is also quick to provide previews of the latest models. However, the lack of quota in the Japan region is an issue.

  • The four products we released in one year gave us insight into how users ask questions and use the products in what situations, which is important for UX strategy.

  • Full-stack Azure is effective for generative AI product development. Use it together to strengthen the Japan Region.

  • According to Mr. Ando of Price.com, the most important thing in a development organization is psychological safety. It is important to create an environment where everyone can openly express their opinions.

    • Price.com separates the definition of productivity from creative work. While Copilot is effective for repetitive tasks, productivity is difficult to measure easily.

  • The introduction of Copilot has lowered the psychological hurdle to coding and the automatic generation of test codes has improved the overall quality. It has also increased knowledge and improved skills.

  • On the other hand, there is a concern that they may become too dependent on Copilot and stop learning on their own. Depending on how the tool is used, there could be a difference in the degree of growth of engineers.

    • With those who accelerate more with Copilot,ハンドルを委ねてしまう人がいるnishio.icon
      • The latter were doing copy-and-paste programming before AI, so the situation would be no different.

  • Price.com, which has been in operation for 27 years, faces the challenge of balancing the challenge of new technology with a sincere commitment to legacy systems. The company is moving forward while gaining the organization's understanding of costs and regrets.

  • In the future, we expect to see AI that can understand the context of source code, generate documentation, explain functions, etc. This will help to eliminate black boxing.

  • Mr. Kobayashi concluded his presentation by saying that Microsoft, as a user of Copilot, is also conducting business while utilizing it, and that the name "Copilot" comes from "co-pilot," and that he wants to be in a position to help user companies grow.

This page is auto-translated from [/nishio/Azure Tech Day March 2024 Edition](https://scrapbox.io/nishio/Azure Tech Day March 2024 Edition) using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I'm very happy to spread my thought to non-Japanese readers.

(C)NISHIO Hirokazu / Converted from Markdown (en)
Source: [GitHub] / [Scrapbox]