Azure AI services offer a wide range of tools and capabilities for developers and businesses to leverage the power of artificial intelligence in their applications. Several AI services are available and provided by different vendors, including Azure, AWS, and Google Cloud Platform. Understanding the overview, features, limitations, and most importantly the use case scenario of these services is essential.
As part of this blog, I will provide an overview of the Azure AI services available, the tools used to use these services (using AI Studio or the Azure SDK), and the deprecated Azure AI services
Overview:
What are Azure AI services?
Azure AI services help developers and organizations rapidly create intelligent, cutting-edge, market-ready, and responsible applications with out-of-the-box and prebuilt and customizable APIs and models.
Example applications include natural language processing for conversations, search, monitoring, translation, speech, vision, and decision-making.
Most Azure AI services are available through REST APIs and client library SDKs in popular development languages.
What are the available Azure AI services?
Microsoft Azure provides a wide range of AI services, each catering to specific needs and applications. Some of the key Azure AI services include:
Azure Cognitive Search:
This service enables users to create intelligent search experiences with AI-powered features like sentiment analysis, entity extraction, and face detection. It allows users to search and analyze text, images, and video data.
Azure Cognitive Speech Services:
This service enables developers to build speech-to-text and text-to-speech applications using advanced speech recognition and language models. It offers features like real-time transcription, speech synthesis, and sentiment analysis.
Azure Cognitive Vision Service:
This service enables developers to build computer vision applications using AI algorithms and models. It provides features such as image recognition, object detection, and facial recognition.
Azure Bot Service:
This service allows users to build intelligent chatbots and conversational agents using drag-and-drop tools and pre-built templates. It offers features such as natural language processing, sentiment analysis, and intent recognition.
Azure Machine Learning:
This service provides a platform for building, training, and deploying machine learning models. It offers features like drag-and-drop interface, automated model training, and built-in algorithms.
Below is the list of services available.
Deprecated Services:
Few of the services released earlier are now deprecated, below are these services.
| ID# | Deprecated Service | Replaced by Service |
| 1 | Azure Cognitive Face Service | Azure Face API. |
| 2 | Azure Text Analytics | Azure Cognitive Search. |
| 3 | Azure Cognitive Search Connector for Bing Search | Azure Cognitive Search Connector for Bing |
| 4 | Content Moderator | Azure AI Content Safety |
| 5 | Language Understanding (LUIS) | Conversational Language Understanding (CLU) |
| 6 | QnA Maker | Question Answering |
| 7 | Metrics Advisor | Anomaly Detector |
| 8 | Anomaly Detector | Anomaly Detector |
Summary of these AI services:
| Natural language processing | Knowledge mining and document intelligence | Computer vision | Decision support | Generative AI |
| Text analysis | AI Search | Image analysis | Content safety | Azure OpenAI Service |
| Question answering | Document Intelligence | Video analysis | Content moderation | DALL-E image generation |
| Language understanding | Custom Document Intelligence | Image classification | ||
| Translation | Custom skills | Object detection | ||
| Named entity recognition | Facial analysis | |||
| Custom text classification | Optical character recognition | |||
| Speech | Azure AI Video Indexer | |||
| Speech Translation |
Use Case Scenarios:
Azure AI services can be used across various industries and applications. Some common use cases include:
– Customer Support: AI-powered chatbots can automate customer support processes, enabling fast and accurate responses to queries.
– Document Processing: AI algorithms can analyze and extract information from documents, streamlining data entry and automating workflows.
– Personalization: AI algorithms can analyze user data and recommend personalized content, improving user experience and engagement.
– Image Recognition: AI algorithms can analyze images and identify objects, people, or emotions, enabling a wide range of applications, such as security and surveillance.
– Speech Recognition: AI-powered transcription and speech synthesis can enable hands-free communication, transcription, and voice-driven applications.
What are the Development Options (Tools, SDK, API) available for these AI Services?
Azure offers a wide range of tools that are designed for diverse types of users, many of which can be used with Azure AI services.
Designer-driven tools:
Designer-driven tools are the easiest to use, and are quick to set up and automate, but might have limitations when it comes to customization.
Rest API and Client libraries:
REST APIs and client libraries provide users with more control and flexibility, but require more effort, time, and expertise to build a solution.
Language support: C#, Java, Python, JavaScript, or another popular programming language.
What is Azure AI Studio (Currently in preview)?
Azure AI studio is designed for developers to build generative AI applications on an enterprise-grade platform.
From the studio you can directly interact with a project code-first via the Azure AI SDK and Azure AI CLI.
Azure AI Studio is a trusted and inclusive platform that empowers developers of all abilities and preferences to innovate with AI and shape the future.
Seamlessly explore, build, test, and deploy using cutting-edge AI tools and ML models, grounded in responsible AI practices.
Pricing tiers and billing
Pricing tiers (and the amount you get billed) are based on the number of transactions you send using your authentication information. Each pricing tier specifies the:
- Maximum number of allowed transactions per second (TPS).
- Service features enabled within the pricing tier.
- Cost for a predefined number of transactions. Going above this number causes an extra charge as specified in the pricing details for your service.
Regional availability
The APIs in Azure AI services are hosted on a growing network of Microsoft-managed data centers.
Language support
Azure AI services support a wide range of cultural languages at the service level.
Security
Azure AI services provide a layered security model, including authentication with Microsoft Entra credentials, a valid resource key, and Azure Virtual Networks.
Certifications and compliance
Azure AI services awarded certifications include Cloud Security Alliance STAR Certification, FedRAMP Moderate, and HIPAA BAA.
Responsible AI
At Microsoft, AI software development is guided by a set of six principles, designed to ensure that AI applications provide amazing solutions to difficult problems without any unintended negative consequences.
Fairness:
AI systems should treat all people fairly. For example, suppose you create a machine learning model to support a loan approval application for a bank. The model should predict whether the loan should be approved or denied without bias. This bias could be based on gender, ethnicity, or other factors that result in an unfair advantage or disadvantage to specific groups of applicants.
Reliability and safety
AI systems should perform reliably and safely. For example, consider an AI-based software system for an autonomous vehicle; or a machine learning model that diagnoses patient symptoms and recommends prescriptions. Unreliability in these kinds of systems can result in substantial risk to human life.
Privacy and security
AI systems should be secure and respect privacy. The machine learning models on which AI systems are based rely on large volumes of data, which may contain personal details that must be kept private. Even after the models are trained and the system is in production, privacy and security need to be considered
Inclusiveness
AI systems should empower everyone and engage people. AI should bring benefits to all parts of society, regardless of physical ability, gender, sexual orientation, ethnicity, or other factors.
Transparency
AI systems should be understandable. Users should be made fully aware of the purpose of the system, how it works, and what limitations may be expected.
Accountability
People should be accountable for AI systems. Designers and developers of AI-based solutions should work within a framework of governance and organizational principles that ensure the solution meets ethical and legal standards that are clearly defined.
Demo
Let’s explore Azure AI Vision service and see how to use this feature in the Azure AI Studio.
In the demo, we will upload a sample image to the Azure AI Studio and use Azure Vision Service to analyze the image. We will then explore the detected objects and display the results in the Azure AI Studio console. This demo provides a simple example of how to integrate Azure AI Services into your applications and gain insights from visual data.
Azure AI Vision is a powerful AI service that offers a range of features for image analysis, video analysis, face detection, and recognition. By utilizing Azure AI Studio, developers can easily integrate these features into their applications, enabling them to build innovative solutions that leverage the power of AI Vision.
A detailed overview of Azure AI Vision and its features can be found in another blog post. Click here for the complete details: Getting started with AI vision
Conclusion
In conclusion, Azure offers a comprehensive suite of AI services that enable businesses to unlock the full potential of AI. These services provide developers with the building blocks needed to develop AI-powered applications, streamline processes, and make informed decisions.
We also explored one of the Azure AI Services called AI Vision and saw, how to leverage AI Vision Studio to explore its features (Image Analysis, Tagging images, Object detection).
In the next blog, we will delve deeper into each of these Azure AI services, exploring their features, limitations, and use case scenarios. By gaining a deeper understanding of each service, developers can make informed choices and select the appropriate services to meet the specific needs of their projects.
Stay tuned for our next blog, where we will explore the various Azure AI services in more detail.
References:
https://learn.microsoft.com/en-us/azure/ai-services
https://learn.microsoft.com/en-us/azure/ai-studio/what-is-ai-studio?tabs=home
https://learn.microsoft.com/en-us/azure/ai-studio/how-to/sdk-install?tabs=windows