Amazon’s Bedrock and Titan Generative AI Services Enter General Availability

We Keep you Connected

Amazon’s Bedrock and Titan Generative AI Services Enter General Availability

Amazon’s Bedrock and Titan Generative AI Services Enter General Availability
Your email has been sent
Amazon Bedrock opens the door to two new large language models hosted on AWS. Plus, AWS added generative AI to QuickSight and CodeWhisperer.
Amazon has added generative artificial intelligence models into Amazon Web Services.
With Amazon Bedrock, customers can build and scale generative AI-based applications through an API. From there, the libraries of Amazon Titan FMs, which include two large language models, can be accessed, along with other models from AI21 Labs, Anthropic, Cohere, Meta, Stability AI and Amazon.
Jump to:
Amazon Bedrock is a service that provides access to generative AI on the cloud. Technically, Amazon Bedrock is a library of foundation models, all of which provide similar content-generating abilities. Since Amazon Bedrock’s models are hosted by AWS, existing clients can access them through their usual channels and not have to worry about hosting the model’s large amounts of data on their own infrastructure. However, enterprise clients will be able to feed data sets of their choice into the models.
Perhaps mindful of worries about security, Amazon reassured people that data fed into a training model in this way would not be used to train future iterations back at Amazon HQ.
Customers will also be able to use familiar AWS controls for the new AI. It connects to the cloud-based machine learning platform SageMaker ML, which includes an environment in which to test different models and a feature for managing foundation models at scale.
SEE: Looking to get started with ChatGPT
On September 28, 2023, AWS announced that Llama 2, Meta’s current-generation large language model, will be available in Amazon Bedrock through a managed API; it is expected to be accessible in mid- to late October. Amazon Bedrock subscribers will be able to choose between the 13B or 70B parameter Llama 2 models.
AWS customers can sign up for an Amazon Bedrock subscription now. Amazon Bedrock pricing varies based on specific services; the full list of services is on the pricing page.
While Amazon Bedrock is the service, Amazon Titan is the content. Amazon Titan plans to offer two AI models: one that creates text and one that improves searches and personalizations. In addition to creating new text such as blog posts or emails, Amazon Titan can sort items into different classifications, hold open-ended conversations and extract specific information from chunks of text.
On September 28, AWS announced the first available Amazon Titan model called Titan Embeddings, which enhances searches by tailoring the results to more relevant and contextual responses. Titan Embeddings is a large language model trained for retrieval-augmented generation, a model-customization technique that allows organizations to include timely knowledge or proprietary data in searches. A model similar to this one is already at work in Amazon’s product search.
Once organizations have the AI hooked up to their existing AWS, Amazon said they can customize a model by feeding it just 20 examples of the kind of task that particular organization might want the AI to complete.
“We predict that most businesses’ long-term approach will be to customize large language models to their needs and data instead of out-of-the-box model usage,” a Slalom representative told Amazon.
Accenture, Deloitte, Infosys and Slalom were early integration partners.
Coda was one of the organizations using Amazon Bedrock in preview. “Since all our data is already on AWS, we are able to quickly incorporate generative AI using Bedrock, with all the security and privacy we need to protect our data built-in,” said Shishir Mehrotra, co-founder and CEO of Coda.
Another possible AI use case specifically for developers comes from CodeWhisperer, an AI-based coding assistant. In April 2023, Amazon announced CodeWhisperer now has a free tier. The no-cost Individual tier provides access to automated code-writing that lives inside a developer’s existing integrated development environment.
CodeWhisperer works well for “creating code for routine or time-consuming, undifferentiated tasks, working with unfamiliar APIs or SDKs, making correct and effective use of AWS APIs, and other common coding scenarios such as reading and writing files, image processing, writing unit tests,” Amazon wrote in a press release. The Professional tier, which is available now, offers more features, such as single sign-on and identity and access management Identity Center integration and higher limits on security scanning.
On September 28, 2023, AWS expanded CodeWhisperer with a generative AI recommendation capability to help developers problem-solve in their internal, private APIs, libraries, packages and classes. Developers can provide a GitHub or Amazon S3 link to their private repository from CodeWhisperer. The customized recommendation capability is expected to be available in preview in the upcoming Amazon CodeWhisperer Enterprise tier “soon,” AWS said in a press release.
AWS and Amazon Titan do not use internal customizations for training or store or log any customer content from the Amazon CodeWhisperer Professional or Enterprise tiers, AWS said.
Business intelligence analysts can leverage generative AI to create visuals in Amazon QuickSight with Amazon QuickSight Q, which is now available as a free trial. QuickSight Q can answer questions or create charts and graphs based on natural-language queries. The visuals can then be added to reports or dashboards created in QuickSight.
Amazon Bedrock’s major competitors are the enterprise subscription for OpenAI’s ChatGPT and Google’s PaLM 2 model, which is available for enterprise customers through Google’s Vertex AI platform.
Catch up on the latest tech innovations that are changing the world, including IoT, 5G, the latest about phones, security, smart cities, AI, robotics, and more.
Amazon’s Bedrock and Titan Generative AI Services Enter General Availability
Your email has been sent
TechRepublic Premium content helps you solve your toughest IT issues and jump-start your career or next project.
Microsoft is also running a grant competition for ideas on using AI training in community building.
Generative AI will be a game changer in cloud security, especially in common pain points like preventing threats, reducing toil from repetitive tasks, and bridging the cybersecurity talent gap.
Does your business need a payroll provider that offers international payroll services? Use our buyer’s guide to review the best solutions, from ADP to Oyster.
Get up and running with ChatGPT with this comprehensive cheat sheet. Learn everything from how to sign up for free to enterprise use cases, and start using ChatGPT quickly and effectively.
Looking for an alternative to monday.com? Our comprehensive list covers the best monday alternatives, their key features, pricing, pros, cons and more.
Catch up on the latest tech innovations that are changing the world, including IoT, 5G, the latest about phones, security, smart cities, AI, robotics, and more.
This OneDrive Cloud Usage Policy, courtesy of TechRepublic Premium, defines the practices and behaviors organization representatives must follow when using any Microsoft OneDrive cloud file storage account to execute organization services, process organization data, or access or store organization information. From the policy: No organization representative should ever install a personal OneDrive account on any …
One of the most common and most requested jobs listed by the video game industry is the job of video game designer. Depending on the company, the platform, the project and the company’s specific development process, the job of a video game designer can mean many different things. But at its base level, a game …
For businesses, sustainability means maintaining the ecological, economic and holistic well-being of present and future clients. This entails taking into account the demands and necessities of individuals and society without jeopardizing the growth or wellness of the generations that follow. As an accountable business entity, this policy from TechRepublic Premium defines the company’s commitment to …
TechRepublic Premium was at Confluent’s Current 2023 event, held in San Jose, California, September 26-27. Our coverage of the event comprises an analysis of data streaming, interviews, the role of stream governance and a look at Apache Flink. From the download: Confluent used the Current 2023 ‘next generation of Kafka Summit’ event in San Jose …

source

GET THE LATEST UPDATES, OFFERS, INFORMATION & MORE