{"id":4114,"date":"2024-11-03T08:55:30","date_gmt":"2024-11-03T03:25:30","guid":{"rendered":"https:\/\/navveenbalani.dev\/?p=4114"},"modified":"2024-11-03T08:55:31","modified_gmt":"2024-11-03T03:25:31","slug":"getting-started-with-sustainable-ai-how-different-roles-can-contribute","status":"publish","type":"post","link":"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/","title":{"rendered":"Getting Started with Sustainable AI: How Different Roles Can Contribute"},"content":{"rendered":"\n<p>As AI evolves, sustainability must become a core principle of its development and deployment. Whether you&#8217;re interacting with AI models through APIs like OpenAI or Gemini, fine-tuning existing models, or building AI models from scratch, impactful strategies can make AI more sustainable\u2014through practical, measurable actions. These are some of the strategies that different roles\u2014developers, data scientists, engineers, and application architects\u2014can use to contribute meaningfully to the sustainability of AI.<\/p>\n\n\n\n<h3>1. <strong>Calling APIs: OpenAI, Gemini Models, and More<\/strong><\/h3>\n\n\n\n<p>If you&#8217;re leveraging large AI models like OpenAI&#8217;s or Gemini&#8217;s via APIs, the sustainability impact often comes from the volume of requests and how they are managed. Here\u2019s how to make a tangible difference:<\/p>\n\n\n\n<ul><li><strong>Prompt Caching<\/strong>: Instead of calling an AI model repeatedly for similar responses, cache prompts and their outputs. This reduces the number of API calls, thus decreasing the computational load and energy consumption. By caching effectively, you can significantly reduce redundancy, especially in high-volume applications, making a powerful impact on energy efficiency.<\/li><li><strong>Compression Techniques<\/strong>: Compressing data before sending it to the API can save bandwidth and reduce energy usage. This is particularly important when passing large text blocks or multi-part prompts. Reducing payload size cuts down processing requirements directly, saving both computational energy and cost.<\/li><li><strong>Optimizing API Calls<\/strong>: Batch operations when possible and avoid unnecessary API calls. Use conditional checks to determine whether an AI call is truly needed or if a cached response would suffice. Eliminating redundant processing reduces emissions while also improving response times.<\/li><\/ul>\n\n\n\n<h3>2. <strong>Fine-Tuning Models: Efficient Training Strategies<\/strong><\/h3>\n\n\n\n<p>For data scientists and engineers fine-tuning models, sustainability starts with smarter planning and cutting-edge techniques:<\/p>\n\n\n\n<ul><li><strong>Parameter-Efficient Fine-Tuning<\/strong>: Techniques like LoRA (Low-Rank Adaptation) allow you to modify only a small number of parameters instead of the entire model, reducing computational resources and energy consumption without sacrificing performance.<\/li><li><strong>Energy-Aware Hyperparameter Tuning<\/strong>: Use automated tools to find optimal training parameters that minimize energy usage. By intelligently reducing the search space, hyperparameter tuning becomes significantly more efficient, saving valuable resources.<\/li><li><strong>Model Distillation<\/strong>: If a large model is being fine-tuned, consider distilling it into a smaller, more efficient version after training. This ensures similar performance during inference with far lower energy requirements, leading to more sustainable deployments.<\/li><\/ul>\n\n\n\n<h3>3. <strong>Building AI Models from Scratch: Sustainable Development<\/strong><\/h3>\n\n\n\n<p>When building models from scratch, sustainability should guide every decision from inception:<\/p>\n\n\n\n<ul><li><strong>Select Energy-Efficient Architectures<\/strong>: Some architectures are inherently more energy-intensive than others. Carefully evaluate the energy footprint of different architectures and choose one that provides the best performance-to-efficiency ratio.<\/li><li><strong>Data Efficiency<\/strong>: Reduce redundancy in training data. Use data deduplication and active learning to ensure only the most informative examples are used, which minimizes the training duration and associated energy consumption.<\/li><li><strong>Green Training Practices<\/strong>: Schedule training jobs during times when your cloud provider uses renewable energy. Many providers now offer transparency about energy sources and options to optimize for sustainability, helping you further reduce your carbon footprint.<\/li><\/ul>\n\n\n\n<h3>4. <strong>Holistic Approach to Software Emissions<\/strong><\/h3>\n\n\n\n<p>AI is only one part of a broader software ecosystem, and achieving true sustainability requires a holistic perspective:<\/p>\n\n\n\n<ul><li><strong>Full Stack Optimization<\/strong>: Optimizing the AI model is only part of the solution. Focus on the entire stack\u2014including frontend performance, backend services, and data storage. Efficient code, reduced memory usage, and fast load times not only improve user experience but also reduce the overall energy footprint. For user-facing generative AI apps, optimizing prompts to be concise reduces computation and saves energy, especially at scale.<\/li><li><strong>Auto-Scaling and Carbon Awareness<\/strong>: When deploying generative AI applications, use auto-scaling infrastructure that grows and shrinks based on demand, thus reducing energy waste. Additionally, incorporate carbon-aware scheduling to run compute-heavy tasks during times of lower grid emissions, aligning with periods of renewable energy availability.<\/li><li><strong>Carbon-Aware Development Practices<\/strong>: Adopt practices such as moving workloads to regions with cleaner energy and reducing the carbon impact of data storage by using efficient storage formats and deleting unused data. Integrate these considerations into every stage of development to create end-to-end sustainable software.<\/li><li><strong>Continuous Monitoring and Measurement<\/strong>: Deploy tools to monitor the carbon footprint of your application in real-time. Measure software emissions using metrics like Software Carbon Intensity (SCI) to quantify and track the environmental impact. Regular monitoring allows for ongoing optimizations, ensuring that your AI systems remain sustainable as usage patterns evolve.<\/li><\/ul>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<p>By embracing sustainability throughout every stage\u2014from API usage to building models and deploying applications\u2014we can significantly reduce the environmental impact of AI. Sustainability is not a one-time effort but a continuous, proactive commitment to making intelligent decisions that lead to truly greener AI systems with lasting impact.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As AI evolves, sustainability must become a core principle of its development and deployment. Whether you&#8217;re interacting with AI models through APIs like OpenAI or Gemini, fine-tuning existing models, or building AI models from scratch, impactful strategies can make AI more sustainable\u2014through practical, measurable actions. These are some of the strategies that different roles\u2014developers, data [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":4022,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[3,267,10,324,265,388],"tags":[383,390],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v16.0.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Getting Started with Sustainable AI: How Different Roles Can Contribute - Current and Future Technology Trends by Navveen Balani<\/title>\n<meta name=\"description\" content=\"Getting Started with Sustainable AI: How Different Roles Can Contribute - Sustainability\" \/>\n<link rel=\"canonical\" href=\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Getting Started with Sustainable AI: How Different Roles Can Contribute - Current and Future Technology Trends by Navveen Balani\" \/>\n<meta property=\"og:description\" content=\"Getting Started with Sustainable AI: How Different Roles Can Contribute - Sustainability\" \/>\n<meta property=\"og:url\" content=\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/\" \/>\n<meta property=\"og:site_name\" content=\"Current and Future Technology Trends by Navveen Balani\" \/>\n<meta property=\"article:published_time\" content=\"2024-11-03T03:25:30+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-11-03T03:25:31+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/navveenbalani.dev\/wp-content\/uploads\/2024\/02\/green-gen-ai-nb.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"1024\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\">\n\t<meta name=\"twitter:data1\" content=\"4 minutes\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/navveenbalani.dev\/#website\",\"url\":\"https:\/\/navveenbalani.dev\/\",\"name\":\"Current and Future Technology Trends by Navveen Balani\",\"description\":\"Current and Future Technology Trends by Navveen Balani\",\"publisher\":{\"@id\":\"https:\/\/navveenbalani.dev\/#\/schema\/person\/51f7ab14b20611d95e3c7fd4ea0950bf\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/navveenbalani.dev\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/navveenbalani.dev\/wp-content\/uploads\/2024\/02\/green-gen-ai-nb.jpeg\",\"width\":1024,\"height\":1024},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/#webpage\",\"url\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/\",\"name\":\"Getting Started with Sustainable AI: How Different Roles Can Contribute - Current and Future Technology Trends by Navveen Balani\",\"isPartOf\":{\"@id\":\"https:\/\/navveenbalani.dev\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/#primaryimage\"},\"datePublished\":\"2024-11-03T03:25:30+00:00\",\"dateModified\":\"2024-11-03T03:25:31+00:00\",\"description\":\"Getting Started with Sustainable AI: How Different Roles Can Contribute - Sustainability\",\"breadcrumb\":{\"@id\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/navveenbalani.dev\/\",\"url\":\"https:\/\/navveenbalani.dev\/\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"position\":2,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/\",\"url\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/\",\"name\":\"Getting Started with Sustainable AI: How Different Roles Can Contribute\"}}]},{\"@type\":\"Article\",\"@id\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/#webpage\"},\"author\":{\"@id\":\"https:\/\/navveenbalani.dev\/#\/schema\/person\/51f7ab14b20611d95e3c7fd4ea0950bf\"},\"headline\":\"Getting Started with Sustainable AI: How Different Roles Can Contribute\",\"datePublished\":\"2024-11-03T03:25:30+00:00\",\"dateModified\":\"2024-11-03T03:25:31+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/#webpage\"},\"publisher\":{\"@id\":\"https:\/\/navveenbalani.dev\/#\/schema\/person\/51f7ab14b20611d95e3c7fd4ea0950bf\"},\"image\":{\"@id\":\"https:\/\/navveenbalani.dev\/index.php\/articles\/sustainability\/getting-started-with-sustainable-ai-how-different-roles-can-contribute\/#primaryimage\"},\"keywords\":\"green ai,sustainable ai\",\"articleSection\":\"Articles,Artificial Intelligence,Featured,Generative AI,Machine Learning,Sustainability\",\"inLanguage\":\"en-US\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\/\/navveenbalani.dev\/#\/schema\/person\/51f7ab14b20611d95e3c7fd4ea0950bf\",\"name\":\"Navveen\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/navveenbalani.dev\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/navveenbalani.dev\/wp-content\/uploads\/2019\/07\/navveen_balani.jpeg\",\"width\":200,\"height\":200,\"caption\":\"Navveen\"},\"logo\":{\"@id\":\"https:\/\/navveenbalani.dev\/#personlogo\"},\"sameAs\":[\"http:\/\/naveenbalani.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/navveenbalani.dev\/index.php\/wp-json\/wp\/v2\/posts\/4114"}],"collection":[{"href":"https:\/\/navveenbalani.dev\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/navveenbalani.dev\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/navveenbalani.dev\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/navveenbalani.dev\/index.php\/wp-json\/wp\/v2\/comments?post=4114"}],"version-history":[{"count":1,"href":"https:\/\/navveenbalani.dev\/index.php\/wp-json\/wp\/v2\/posts\/4114\/revisions"}],"predecessor-version":[{"id":4115,"href":"https:\/\/navveenbalani.dev\/index.php\/wp-json\/wp\/v2\/posts\/4114\/revisions\/4115"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/navveenbalani.dev\/index.php\/wp-json\/wp\/v2\/media\/4022"}],"wp:attachment":[{"href":"https:\/\/navveenbalani.dev\/index.php\/wp-json\/wp\/v2\/media?parent=4114"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/navveenbalani.dev\/index.php\/wp-json\/wp\/v2\/categories?post=4114"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/navveenbalani.dev\/index.php\/wp-json\/wp\/v2\/tags?post=4114"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}