{"id":3370,"date":"2024-06-02T19:37:53","date_gmt":"2024-06-03T00:37:53","guid":{"rendered":"https:\/\/www.alighaemi.com\/wp\/?p=3370"},"modified":"2024-06-02T19:37:53","modified_gmt":"2024-06-03T00:37:53","slug":"the-amazon-aws-ai-day","status":"publish","type":"post","link":"https:\/\/www.alighaemi.com\/wp\/?p=3370","title":{"rendered":"The Amazon (AWS) AI Day"},"content":{"rendered":"<p>Amazon, and its partner, Adastra offered a one day AI overview in Toronto recently. It was a hot topic that the presenters encapsulated well. Of course, they had an AWS bias and promoted Amazon&#8217;s services, but the context and implications were presented succinctly and clearly.<\/p>\n<p>Below is a synopsis of the day&#8217;s presentations on Amazon&#8217;s Generative AI (Artificial Intelligence).<\/p>\n<p>AWS (Amazon Web Services &#8211; the Cloud division of Amazon) Options:<u><\/u><u><\/u><\/p>\n<p>1- Powered by Amazon\u2019s\u00a0<i>Bedrock<\/i>\u00a0model<u><\/u><u><\/u><\/p>\n<p>These are sitting on a host of services like Amazon Titan, Cohere, Meta\u2019s Llama 3 and many more<u><\/u><u><\/u><\/p>\n<p>AAS (as a service)\/managed service and no overhead<u><\/u><u><\/u><\/p>\n<p>2- Amazon\u00a0<i>SageMaker<\/i><u><\/u><u><\/u><\/p>\n<p>Which is a \u2018build your own\u2019 platform<u><\/u><u><\/u><\/p>\n<p>&nbsp;<\/p>\n<p>Amazon emphasises, however, that not one LLM fits all. It is important to assess your needs.<\/p>\n<p><u><\/u><u><\/u><\/p>\n<p>New Announcement: <a href=\"https:\/\/aws.amazon.com\/q\/\" target=\"_blank\" rel=\"noopener\">Amazon Q<\/a> (an AI powered assistant)<\/p>\n<p>Designed for business use cases | you can ask questions from it now<u><\/u><u><\/u><\/p>\n<p><u><\/u><u><\/u><\/p>\n<p>Use Cases:\u00a0<u><\/u><u><\/u><\/p>\n<ul type=\"circle\">\n<li>CX\/EX: onboarding, KYC, Routing, etc.<u><\/u><u><\/u><\/li>\n<li>Personalization: Forecast\/advisory, recommend<u><\/u><u><\/u><\/li>\n<li>Text Analytics: Extract information from internal and external sources e.g. in the old days we had OCR with rules on top<u><\/u><u><\/u><\/li>\n<li>Predictive Analytics: Extract data<u><\/u><u><\/u><\/li>\n<li>Fraud Detection: identity fraud, anomalies<u><\/u><u><\/u><\/li>\n<\/ul>\n<p><u><\/u><u><\/u><\/p>\n<p>These were expensive to build and expensive to maintain and therefore fickle until now.<u><\/u><u><\/u><\/p>\n<p>With AI all of the features are baked into the model and therefore a lot less development is required<u><\/u><u><\/u><\/p>\n<p><u><\/u><u><\/u><\/p>\n<p>Additional New Use Cases in Amazon Q:<u><\/u><u><\/u><\/p>\n<ul type=\"circle\">\n<li>Improve CX and EX<u><\/u><u><\/u><\/li>\n<li>Increase knowledge of workers &#8211; think how important this is. We are all in exactly this business whether Marketing, Sales, Compliance or Analysis, etc.<u><\/u><u><\/u><\/li>\n<li>Product Innovation and Process Automation including<u><\/u><u><\/u><\/li>\n<\/ul>\n<ul type=\"circle\">\n<li style=\"list-style-type: none;\">\n<ul type=\"circle\">\n<li>Data Extraction\u00a0<u><\/u><u><\/u><\/li>\n<li>Natural Language Interfaces to Analytics<u><\/u><u><\/u><\/li>\n<li>Personalized Content Generation<u><\/u><u><\/u><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><u><\/u><u><\/u><\/p>\n<p>Amazon Q (Suite of Gen AI Services) Portfolio &#8211; \u201cAI Powered Assistant\u201d General Availability: 30.04.2024 (<i>new!<\/i>) of 3 flavours:<u><\/u><u><\/u><\/p>\n<ol start=\"1\" type=\"1\">\n<li>Amazon Q in QuickSight (powered by Bedrock) can be considered a BI Service with AI Capabilities &#8211; structured data<u><\/u><u><\/u><\/li>\n<li>Amazon For Business &#8211; also unstructured data<u><\/u><u><\/u><\/li>\n<li>Amazon Q Developer &#8211; Assistance in writing code<u><\/u><u><\/u><\/li>\n<\/ol>\n<p><u><\/u><u><\/u><\/p>\n<p>Gen AI assistant for Accelerating software development and leveraging company data<u><\/u><u><\/u><\/p>\n<p>These are being embedded in Amazon Services<u><\/u><u><\/u><\/p>\n<p><u><\/u><u><\/u><\/p>\n<p>Traditionally LLMs have been best for:<u><\/u><u><\/u><\/p>\n<ul type=\"circle\">\n<li>Broad World Information<u><\/u><u><\/u><\/li>\n<li>Assisting Human Work (summarizing, teaching and Generalizing) as well as Offering knowledge, autonomous tasks and calculations<u><\/u><u><\/u><\/li>\n<\/ul>\n<p>But Newly: Amazon Q in QuickSight:\u00a0<u><\/u><u><\/u><\/p>\n<ul type=\"circle\">\n<li>Ask questions in natural languages and ML models interpret user\u2019s questions and generate images and reports.\u00a0<u><\/u><u><\/u><\/li>\n<li>AI powered dashboard.\u00a0<u><\/u><u><\/u><\/li>\n<li>On-demand answers.\u00a0<u><\/u><u><\/u><\/li>\n<li>Can be extended to other Apps.\u00a0<u><\/u><u><\/u><\/li>\n<li>AI assisted Story telling (tells you what is going on and provides documents and slides to present the data)<u><\/u><u><\/u><\/li>\n<\/ul>\n<p><u><\/u><u><\/u><\/p>\n<p>These are available in different apps including your custom apps \u2013 Pricing (in USD):<u><\/u><u><\/u><\/p>\n<ul type=\"circle\">\n<li>Amazon Q Business Lite $3\/user\/month<\/li>\n<li>Amazon Q Business Pro $20\/user\/month<\/li>\n<li>Developer Free Tier<u><\/u><u><\/u><\/li>\n<li>Developer Pro Tier: $19\/user\/month<u><\/u><u><\/u><\/li>\n<li>etc.<\/li>\n<\/ul>\n<p><u><\/u><u><\/u><\/p>\n<p>Benefit: Ask yourself what is the productivity gain? We can see up to 75% productivity gain.<u><\/u><u><\/u><\/p>\n<p>&nbsp;<\/p>\n<p>The AWS approach to Generative AI:<u><\/u><u><\/u>\u00a0<u><\/u><u><\/u><\/p>\n<ul type=\"circle\">\n<li>Enterprise Focus<u><\/u><u><\/u><\/li>\n<li>Open Approach with both Proprietary and Open Source code<u><\/u><u><\/u><\/li>\n<li>Cost And Power Optimized<u><\/u><u><\/u><\/li>\n<li>Data Privacy and Security: Own Your Data\/Access Control included\/Permissions + Connectors to everything including Exchange\/SFDC\/Confluence\/JIRA etc.<u><\/u><u><\/u><\/li>\n<li>Based on the RAG Architecture<u><\/u><u><\/u><\/li>\n<\/ul>\n<p><u><\/u><u><\/u><\/p>\n<p>Generative AI and ML Considerations For Financial Services (because the day had a Financial Services bent nominally) \u00a0\u00a0\u00a0\u00a0 <u><\/u><u><\/u>\u00a0<u><\/u><u><\/u><\/p>\n<ul type=\"circle\">\n<li>Approach? Is a human in the loop and is it possible given the amount of data? Is the input and output from structured or unstructured data?<u><\/u><u><\/u><\/li>\n<li>Governance And Compliance?<u><\/u><u><\/u><\/li>\n<li>Legal &amp; Privacy: Think output validation and Reporting especially when using 3rd Party models\u00a0<u><\/u><u><\/u><\/li>\n<li>Monitor legal and regulatory scope consistently as the scene changes and proposals like SEC\u2019s or European regulation become updated.<u><\/u><u><\/u><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><em>Things That Need To Go Away: The Only Name Tag For An Event To Be Missing Being Mine<\/em><\/p>\n<p>&nbsp;<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-medium wp-image-3371\" src=\"http:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_104438-300x225.jpg\" alt=\"\" width=\"300\" height=\"225\" srcset=\"https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_104438-300x225.jpg 300w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_104438-1024x768.jpg 1024w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_104438-768x576.jpg 768w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_104438-1536x1152.jpg 1536w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_104438-2048x1536.jpg 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/> <img decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-medium wp-image-3372\" src=\"http:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084922-300x225.jpg\" alt=\"\" width=\"300\" height=\"225\" srcset=\"https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084922-300x225.jpg 300w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084922-1024x768.jpg 1024w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084922-768x576.jpg 768w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084922-1536x1152.jpg 1536w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084922-2048x1536.jpg 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/> <img decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-medium wp-image-3373\" src=\"http:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084657-300x225.jpg\" alt=\"\" width=\"300\" height=\"225\" srcset=\"https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084657-300x225.jpg 300w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084657-1024x768.jpg 1024w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084657-768x576.jpg 768w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084657-1536x1152.jpg 1536w, https:\/\/www.alighaemi.com\/wp\/wp-content\/uploads\/20240529_084657-2048x1536.jpg 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Amazon, and its partner, Adastra offered a one day AI overview in Toronto recently. It was a hot topic that the presenters encapsulated well. Of course, they had an AWS bias and promoted Amazon&#8217;s services, but the context and implications were presented succinctly and clearly. Below is a synopsis of the day&#8217;s presentations on Amazon&#8217;s <a href='https:\/\/www.alighaemi.com\/wp\/?p=3370' class='excerpt-more'>[&#8230;]<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_lmt_disableupdate":"","_lmt_disable":""},"categories":[3],"tags":[717,714,716,712,713,715],"aioseo_notices":[],"modified_by":"Ali Ghaemi","_links":{"self":[{"href":"https:\/\/www.alighaemi.com\/wp\/index.php?rest_route=\/wp\/v2\/posts\/3370"}],"collection":[{"href":"https:\/\/www.alighaemi.com\/wp\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.alighaemi.com\/wp\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.alighaemi.com\/wp\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.alighaemi.com\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3370"}],"version-history":[{"count":1,"href":"https:\/\/www.alighaemi.com\/wp\/index.php?rest_route=\/wp\/v2\/posts\/3370\/revisions"}],"predecessor-version":[{"id":3374,"href":"https:\/\/www.alighaemi.com\/wp\/index.php?rest_route=\/wp\/v2\/posts\/3370\/revisions\/3374"}],"wp:attachment":[{"href":"https:\/\/www.alighaemi.com\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3370"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.alighaemi.com\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3370"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.alighaemi.com\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3370"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}