{"id":1074,"date":"2026-02-20T10:00:00","date_gmt":"2026-02-20T09:00:00","guid":{"rendered":"https:\/\/mazennotes.com\/articles\/project\/decentralized-inference-mesh\/"},"modified":"2026-02-20T10:00:00","modified_gmt":"2026-02-20T09:00:00","slug":"decentralized-inference-mesh","status":"publish","type":"fw-portfolio","link":"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/","title":{"rendered":"Decentralized Inference Mesh (Google Cloud Hackathon)"},"content":{"rendered":"<p class=\"wp-block-paragraph\"><em>February 2026 \u2014 Google Cloud Hackathon<\/em><\/p>\n\n<p class=\"wp-block-paragraph\">The first EU AI Act-native orchestration layer for privacy-critical AI applications, enabling compliant AI deployment using local Small Language Models (SLMs) without cloud data egress.<\/p>\n\n<h3 class=\"wp-block-heading\">Key Insights<\/h3>\n\n<ul class=\"wp-block-list\"><li>Developed a Zero-Egress, governance-native orchestration layer for local inference using Ollama.<\/li><li>Implemented an automated regulatory classification engine mapping projects to EU AI Act articles (Art. 5, Annex III, Art. 50).<\/li><li>Engineered a &#8220;Trust &amp; Safety Shield&#8221; for real-time PII blocking and prompt injection prevention.<\/li><li>Built a persistent compliance vault for automated, immutable audit trails of agent interactions (Art. 12).<\/li><li>Designed a sequential Multi-Agent Hive architecture decomposing tasks into specialized Architect, Frontend, and Backend agents.<\/li><\/ul>\n\n<h3 class=\"wp-block-heading\">Tech Stack<\/h3>\n\n<ul class=\"wp-block-list\"><li>Python (FastAPI, Pydantic State Schema)<\/li><li>Ollama (Local SLMs: qwen2.5-coder, llama3)<\/li><li>Streamlit (Visual Dashboard)<\/li><li>Docker &amp; Google Cloud (Vertex AI Hybrid concepts)<\/li><\/ul>\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/github.com\/mazenalhomsie\/decentralized-inference-mesh\" target=\"_blank\" rel=\"noreferrer noopener\">View the project on GitHub<\/a><\/p>","protected":false},"featured_media":0,"template":"","fw-portfolio-category":[75],"class_list":["post-1074","fw-portfolio","type-fw-portfolio","status-publish","hentry","fw-portfolio-category-ai-data-science"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.1.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"Zero-egress orchestration layer for local LLMs, built with Python, FastAPI and Ollama. Automated EU AI Act classification, PII blocking and audit trails.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<link rel=\"canonical\" href=\"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.1.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"de_DE\" \/>\n\t\t<meta property=\"og:site_name\" content=\"Mazen Alhomsi - Software Engineer - Bring Your Ideas to Life\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"Decentralized Inference Mesh \u2013 EU AI Act Compliance Layer\" \/>\n\t\t<meta property=\"og:description\" content=\"Zero-egress orchestration layer for local LLMs, built with Python, FastAPI and Ollama. Automated EU AI Act classification, PII blocking and audit trails.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/mazennotes.com\/wp-content\/uploads\/2021\/09\/Mazen-Alhomsi-scaled.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/mazennotes.com\/wp-content\/uploads\/2021\/09\/Mazen-Alhomsi-scaled.jpg\" \/>\n\t\t<meta property=\"article:tag\" content=\"a:0:{}\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2026-02-20T09:00:00+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2026-02-20T09:00:00+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/facebook.com\/mazenalhomsie\" \/>\n\t\t<meta property=\"article:author\" content=\"Mazen Alhomsie\" \/>\n\t\t<meta name=\"twitter:card\" content=\"summary\" \/>\n\t\t<meta name=\"twitter:site\" content=\"@mazenalhomsie\" \/>\n\t\t<meta name=\"twitter:title\" content=\"Decentralized Inference Mesh \u2013 EU AI Act Compliance Layer\" \/>\n\t\t<meta name=\"twitter:description\" content=\"Zero-egress orchestration layer for local LLMs, built with Python, FastAPI and Ollama. Automated EU AI Act classification, PII blocking and audit trails.\" \/>\n\t\t<meta name=\"twitter:image\" content=\"https:\/\/mazennotes.com\/wp-content\/uploads\/2021\/09\/Mazen-Alhomsi-scaled.jpg\" \/>\n\t\t<script type=\"application\/ld+json\" class=\"aioseo-schema\">\n\t\t\t{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/project\\\/decentralized-inference-mesh\\\/#breadcrumblist\",\"itemListElement\":[{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de#listItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mazennotes.com\\\/de\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/project\\\/#listItem\",\"name\":\"Projects\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/project\\\/#listItem\",\"position\":2,\"name\":\"Projects\",\"item\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/project\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/portfolio\\\/ai-data-science\\\/#listItem\",\"name\":\"AI &amp; Data Science\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de#listItem\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/portfolio\\\/ai-data-science\\\/#listItem\",\"position\":3,\"name\":\"AI &amp; Data Science\",\"item\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/portfolio\\\/ai-data-science\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/project\\\/decentralized-inference-mesh\\\/#listItem\",\"name\":\"Decentralized Inference Mesh (Google Cloud Hackathon)\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/project\\\/#listItem\",\"name\":\"Projects\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/project\\\/decentralized-inference-mesh\\\/#listItem\",\"position\":4,\"name\":\"Decentralized Inference Mesh (Google Cloud Hackathon)\",\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/portfolio\\\/ai-data-science\\\/#listItem\",\"name\":\"AI &amp; Data Science\"}}]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/#person\",\"name\":\"Mazen Alhomsi\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/project\\\/decentralized-inference-mesh\\\/#personImage\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/072d7c0c3685ca5488129499bda64fc498dc3360007dd352bd01d7c40d3a5a64?s=96&d=mm&r=g\",\"width\":96,\"height\":96,\"caption\":\"Mazen Alhomsi\"},\"sameAs\":[\"Mazen Alhomsie\",\"Mazen Alhomsie\"]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/project\\\/decentralized-inference-mesh\\\/#webpage\",\"url\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/project\\\/decentralized-inference-mesh\\\/\",\"name\":\"Decentralized Inference Mesh \\u2013 EU AI Act Compliance Layer\",\"description\":\"Zero-egress orchestration layer for local LLMs, built with Python, FastAPI and Ollama. Automated EU AI Act classification, PII blocking and audit trails.\",\"inLanguage\":\"de-DE\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/#website\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/articles\\\/project\\\/decentralized-inference-mesh\\\/#breadcrumblist\"},\"datePublished\":\"2026-02-20T10:00:00+01:00\",\"dateModified\":\"2026-02-20T10:00:00+01:00\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/#website\",\"url\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/\",\"name\":\"Mazen Alhomsi - Software Engineer Mazen Alhomsi - Software Engineer\",\"description\":\"Bring Your Ideas to Life\",\"inLanguage\":\"de-DE\",\"publisher\":{\"@id\":\"https:\\\/\\\/mazennotes.com\\\/de\\\/#person\"}}]}\n\t\t<\/script>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"Decentralized Inference Mesh \u2013 EU AI Act Compliance Layer","description":"Zero-egress orchestration layer for local LLMs, built with Python, FastAPI and Ollama. Automated EU AI Act classification, PII blocking and audit trails.","canonical_url":"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"BreadcrumbList","@id":"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/#breadcrumblist","itemListElement":[{"@type":"ListItem","@id":"https:\/\/mazennotes.com\/de#listItem","position":1,"name":"Home","item":"https:\/\/mazennotes.com\/de","nextItem":{"@type":"ListItem","@id":"https:\/\/mazennotes.com\/de\/articles\/project\/#listItem","name":"Projects"}},{"@type":"ListItem","@id":"https:\/\/mazennotes.com\/de\/articles\/project\/#listItem","position":2,"name":"Projects","item":"https:\/\/mazennotes.com\/de\/articles\/project\/","nextItem":{"@type":"ListItem","@id":"https:\/\/mazennotes.com\/de\/articles\/portfolio\/ai-data-science\/#listItem","name":"AI &amp; Data Science"},"previousItem":{"@type":"ListItem","@id":"https:\/\/mazennotes.com\/de#listItem","name":"Home"}},{"@type":"ListItem","@id":"https:\/\/mazennotes.com\/de\/articles\/portfolio\/ai-data-science\/#listItem","position":3,"name":"AI &amp; Data Science","item":"https:\/\/mazennotes.com\/de\/articles\/portfolio\/ai-data-science\/","nextItem":{"@type":"ListItem","@id":"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/#listItem","name":"Decentralized Inference Mesh (Google Cloud Hackathon)"},"previousItem":{"@type":"ListItem","@id":"https:\/\/mazennotes.com\/de\/articles\/project\/#listItem","name":"Projects"}},{"@type":"ListItem","@id":"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/#listItem","position":4,"name":"Decentralized Inference Mesh (Google Cloud Hackathon)","previousItem":{"@type":"ListItem","@id":"https:\/\/mazennotes.com\/de\/articles\/portfolio\/ai-data-science\/#listItem","name":"AI &amp; Data Science"}}]},{"@type":"Person","@id":"https:\/\/mazennotes.com\/de\/#person","name":"Mazen Alhomsi","image":{"@type":"ImageObject","@id":"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/#personImage","url":"https:\/\/secure.gravatar.com\/avatar\/072d7c0c3685ca5488129499bda64fc498dc3360007dd352bd01d7c40d3a5a64?s=96&d=mm&r=g","width":96,"height":96,"caption":"Mazen Alhomsi"},"sameAs":["Mazen Alhomsie","Mazen Alhomsie"]},{"@type":"WebPage","@id":"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/#webpage","url":"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/","name":"Decentralized Inference Mesh \u2013 EU AI Act Compliance Layer","description":"Zero-egress orchestration layer for local LLMs, built with Python, FastAPI and Ollama. Automated EU AI Act classification, PII blocking and audit trails.","inLanguage":"de-DE","isPartOf":{"@id":"https:\/\/mazennotes.com\/de\/#website"},"breadcrumb":{"@id":"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/#breadcrumblist"},"datePublished":"2026-02-20T10:00:00+01:00","dateModified":"2026-02-20T10:00:00+01:00"},{"@type":"WebSite","@id":"https:\/\/mazennotes.com\/de\/#website","url":"https:\/\/mazennotes.com\/de\/","name":"Mazen Alhomsi - Software Engineer Mazen Alhomsi - Software Engineer","description":"Bring Your Ideas to Life","inLanguage":"de-DE","publisher":{"@id":"https:\/\/mazennotes.com\/de\/#person"}}]},"og:locale":"de_DE","og:site_name":"Mazen Alhomsi - Software Engineer - Bring Your Ideas to Life","og:type":"article","og:title":"Decentralized Inference Mesh \u2013 EU AI Act Compliance Layer","og:description":"Zero-egress orchestration layer for local LLMs, built with Python, FastAPI and Ollama. Automated EU AI Act classification, PII blocking and audit trails.","og:url":"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/","og:image":"https:\/\/mazennotes.com\/wp-content\/uploads\/2021\/09\/Mazen-Alhomsi-scaled.jpg","og:image:secure_url":"https:\/\/mazennotes.com\/wp-content\/uploads\/2021\/09\/Mazen-Alhomsi-scaled.jpg","article:tag":["a:0:{}"],"article:published_time":"2026-02-20T09:00:00+00:00","article:modified_time":"2026-02-20T09:00:00+00:00","article:publisher":"https:\/\/facebook.com\/mazenalhomsie","article:author":"Mazen Alhomsie","twitter:card":"summary","twitter:site":"@mazenalhomsie","twitter:title":"Decentralized Inference Mesh \u2013 EU AI Act Compliance Layer","twitter:description":"Zero-egress orchestration layer for local LLMs, built with Python, FastAPI and Ollama. Automated EU AI Act classification, PII blocking and audit trails.","twitter:image":"https:\/\/mazennotes.com\/wp-content\/uploads\/2021\/09\/Mazen-Alhomsi-scaled.jpg"},"aioseo_meta_data":{"post_id":"1074","title":"Decentralized Inference Mesh \u2013 EU AI Act Compliance Layer","description":"Zero-egress orchestration layer for local LLMs, built with Python, FastAPI and Ollama. Automated EU AI Act classification, PII blocking and audit trails.","keywords":null,"keyphrases":{"focus":{"keyphrase":"eu ai act compliant ai orchestration","score":0,"analysis":[]},"additional":[]},"primary_term":null,"canonical_url":null,"og_title":"Decentralized Inference Mesh \u2013 EU AI Act Compliance Layer","og_description":"Zero-egress orchestration layer for local LLMs, built with Python, FastAPI and Ollama. Automated EU AI Act classification, PII blocking and audit trails.","og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":"","og_custom_url":null,"og_article_section":null,"og_article_tags":"[{\"label\":\"a:0:{}\",\"value\":\"a:0:{}\"}]","twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":"Decentralized Inference Mesh \u2013 EU AI Act Compliance Layer","twitter_description":"Zero-egress orchestration layer for local LLMs, built with Python, FastAPI and Ollama. Automated EU AI Act classification, PII blocking and audit trails.","schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"WebPage","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":"-1","robots_max_videopreview":"-1","robots_max_imagepreview":"large","priority":null,"frequency":"default","local_seo":null,"breadcrumb_settings":null,"limit_modified_date":false,"ai":{"faqs":[],"keyPoints":[],"schemas":[],"titles":[],"descriptions":[],"socialPosts":{"email":[],"linkedin":[],"twitter":[],"facebook":[],"instagram":[]}},"created":"2026-08-25 09:02:34","updated":"2026-08-25 11:40:44","seo_analyzer_scan_date":null,"focus_keyword":"eu ai act compliant ai orchestration","additional_keywords":null,"truseo_locale":null},"aioseo_breadcrumb":"<div class=\"aioseo-breadcrumbs\"><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/mazennotes.com\/de\" title=\"Home\">Home<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/mazennotes.com\/de\/articles\/project\/\" title=\"Projects\">Projects<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/mazennotes.com\/de\/articles\/portfolio\/ai-data-science\/\" title=\"AI &amp; Data Science\">AI &amp; Data Science<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\tDecentralized Inference Mesh (Google Cloud Hackathon)\n\t\t<\/span><\/div>","aioseo_breadcrumb_json":[{"label":"Home","link":"https:\/\/mazennotes.com\/de"},{"label":"Projects","link":"https:\/\/mazennotes.com\/de\/articles\/project\/"},{"label":"AI &amp; Data Science","link":"https:\/\/mazennotes.com\/de\/articles\/portfolio\/ai-data-science\/"},{"label":"Decentralized Inference Mesh (Google Cloud Hackathon)","link":"https:\/\/mazennotes.com\/de\/articles\/project\/decentralized-inference-mesh\/"}],"_links":{"self":[{"href":"https:\/\/mazennotes.com\/de\/wp-json\/wp\/v2\/fw-portfolio\/1074","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mazennotes.com\/de\/wp-json\/wp\/v2\/fw-portfolio"}],"about":[{"href":"https:\/\/mazennotes.com\/de\/wp-json\/wp\/v2\/types\/fw-portfolio"}],"version-history":[{"count":0,"href":"https:\/\/mazennotes.com\/de\/wp-json\/wp\/v2\/fw-portfolio\/1074\/revisions"}],"wp:attachment":[{"href":"https:\/\/mazennotes.com\/de\/wp-json\/wp\/v2\/media?parent=1074"}],"wp:term":[{"taxonomy":"fw-portfolio-category","embeddable":true,"href":"https:\/\/mazennotes.com\/de\/wp-json\/wp\/v2\/fw-portfolio-category?post=1074"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}