<?xml version="1.0" encoding="utf-8"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Posts · Mesh Refinement</title><link>https://meshrefine.com/en/tags/ai/</link><description>Posts · Mesh Refinement</description><atom:link href="https://meshrefine.com/en/tags/ai/index.xml" rel="self" type="application/rss+xml"/><lastBuildDate>Mon, 31 Aug 2026 20:21:50 +0200</lastBuildDate><item><title>Chronicles. Aug. 24 - Aug. 30 2026</title><link>https://meshrefine.com/en/posts/chronicles-aug-24-aug-30-2026/</link><description>&lt;p&gt;It&amp;rsquo;s Monday, and so it&amp;rsquo;s time for the next issue of Chronicles. Last week was very significant because it represented a tectonic shift from using expensive, efficient models to cheap and still very efficient models. In other words, AI is getting democratized.&lt;/p&gt;
&lt;p&gt;Let&amp;rsquo;s start with the hardware. This week we&amp;rsquo;ve seen interesting news from OpenAI, which &lt;a href="https://openai.com/index/jalapeno-first-results"&gt;published the first benchmarks&lt;/a&gt; for their Jalapeño chip, a custom inference chip designed with Broadcom. It&amp;rsquo;s pretty impressive. They published &lt;a href="https://newsletter.semianalysis.com/p/openai-jalapeno-better-than-nvidia"&gt;over 700 tokens per second per user on DeepSeek R1 at concurrency of one, and about 1400 on Kimi K2.5 and GPT-OSS&lt;/a&gt;. The variety here matters because the chip has been benchmarked not only on OpenAI&amp;rsquo;s own models but on open-weight models from other vendors as well. The chip is critical in the ongoing price war with the Chinese providers. Remember that last week we had data on &lt;a href="https://community.openai.com/t/20-price-reduction-for-gpt-5-6-sol-api-codex-credits-and-chatgpt-work/1391726"&gt;cutting prices on their Sol model&lt;/a&gt; by 20% on input and 33% on output, which is a promotional window that expires on 21 November, and a week before that they &lt;a href="https://arstechnica.com/ai/2026/08/openai-and-anthropic-in-price-war-as-chinese-ai-rivals-gain-ground/"&gt;cut the price of Luna by a whopping 80%&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Mon, 31 Aug 2026 20:21:50 +0200</pubDate><guid>https://meshrefine.com/en/posts/chronicles-aug-24-aug-30-2026/</guid></item><item><title>Chronicles. Aug. 17 - Aug. 23 2026</title><link>https://meshrefine.com/en/posts/chronicles-aug-17-aug-23-2026/</link><description>&lt;p&gt;Last week was all about the harness. Gone are the times when the models were all things-in-themselves. Now, as with early Homo erectus, the tools are the factor of survival.
If we look at the types of harness-related posts and announcements, we will see three trends.&lt;/p&gt;
&lt;h2 id="04602056b054f8f419959cfb26ab2e8f-harness-products"&gt;Harness products&lt;/h2&gt;
&lt;p&gt;Several companies have released either agents or infra for agents at once.&lt;/p&gt;
&lt;p&gt;OpenAI has &lt;a href="https://developers.openai.com/blog/codex-as-a-platform"&gt;released the execution framework&lt;/a&gt; that their Codex (the CLI one) is based on. Unsurprisingly called Harness, it is their answer to the &lt;a href="https://code.claude.com/docs/en/agent-sdk/overview"&gt;Claude Agent SDK&lt;/a&gt; and the &lt;a href="https://docs.github.com/en/copilot/how-tos/copilot-sdk"&gt;GitHub Copilot SDK&lt;/a&gt;. The Harness provides the execution loop, memory, tools, and other necessities of agentic life. You can use it in three different ways. First, you can just use &lt;code&gt;codex exec&lt;/code&gt; to run non-interactive jobs. Second, you can use the Codex SDK for building workflows. And last, you can use app-server to build apps that require conversation handling.
One point worthy of attention is that they claim that the Harness improved the performance of the GPT-5.6 Sol model from 13.3% to 38.3% on ARC-AGI-3. It&amp;rsquo;s unclear what harness (not capitalized) was used as a baseline, though.&lt;/p&gt;</description><pubDate>Mon, 24 Aug 2026 20:03:30 +0200</pubDate><guid>https://meshrefine.com/en/posts/chronicles-aug-17-aug-23-2026/</guid></item><item><title>Chronicles. Aug. 09 - Aug. 16 2026</title><link>https://meshrefine.com/en/posts/chronicles-aug-09-aug-16-2026/</link><description>&lt;p&gt;Over the last week, we&amp;rsquo;ve seen some announcements from both the highest-end and lowest-end sides of open-weight models. At the same time, labs are starting to think that maaaybe, just maybe, we move too fast and we need to stop and think. So, in their free time, they are starting price wars.&lt;/p&gt;
&lt;h2 id="d8260bc688ef019c5f40c851636b0844-models-hi"&gt;Models, hi&lt;/h2&gt;
&lt;p&gt;Last week we saw a bunch of releases of very large open-weight models. Z.ai shipped &lt;a href="https://z.ai/blog/glm-5.3"&gt;GLM-5.3&lt;/a&gt;, which is relatively small, just 743B, DeepSeek published their 1.6T &lt;a href="https://api-docs.deepseek.com/news/news260813/"&gt;V4-Pro&lt;/a&gt; weights under the MIT license, and Alibaba surprised with a whopping 2.4-trillion-parameter &lt;a href="https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B"&gt;Qwen3.8&lt;/a&gt;. Although they are open, doing anything meaningful with models of this size requires hardware not a lot of individuals have, which defeats their openness a little. On the other hand, they &lt;em&gt;open&lt;/em&gt; possibilities for 3rd-party hosting and incentivize the price wars I will talk about below.&lt;/p&gt;</description><pubDate>Sun, 16 Aug 2026 09:31:26 +0200</pubDate><guid>https://meshrefine.com/en/posts/chronicles-aug-09-aug-16-2026/</guid></item><item><title>Chronicles. Aug. 01 - Aug. 08 2026</title><link>https://meshrefine.com/en/posts/chronicles-aug-01-aug-08-2026/</link><description>&lt;p&gt;This article opens a series (I expect it to become one) of posts in which I review the AI-related events of the past week and try to figure out how they fit into the bigger picture.&lt;/p&gt;
&lt;p&gt;The main highlights of the past week are:&lt;/p&gt;
&lt;ol&gt;
&lt;li&gt;
&lt;p&gt;We continue to see real-world security breaches caused by AI system evaluations, and it looks like another race.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;Major regulations came into force.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;Data centres face increasing opposition from local communities. Companies seek workarounds.&lt;/p&gt;</description><pubDate>Sun, 09 Aug 2026 07:47:17 +0200</pubDate><guid>https://meshrefine.com/en/posts/chronicles-aug-01-aug-08-2026/</guid></item><item><title>The Treachery of Memory: On Long Contexts and Agentic Failures</title><link>https://meshrefine.com/en/posts/long-context-failures-and-fixes/</link><description>&lt;p&gt;&lt;a href="https://www.dbreunig.com/2025/06/22/how-contexts-fail-and-how-to-fix-them.html"&gt;How Long Contexts Fail&lt;/a&gt;&lt;/p&gt;
&lt;p&gt;&lt;a href="https://www.dbreunig.com/2025/06/26/how-to-fix-your-context.html"&gt;How to Fix Your Context&lt;/a&gt;&lt;/p&gt;
&lt;p&gt;Long context is your friend&amp;hellip; when we are talking about summarization and retrieval. For agentic workflow it is often detrimental due to reasons such as:&lt;/p&gt;
&lt;ol&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Context poisoning&lt;/strong&gt;, where the model hallucinates and messes with its own context. The ripples are powerful and they die slowly;&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Context distraction&lt;/strong&gt;, where the model starts to repeat itself instead of trying new strategies;&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Context confusion&lt;/strong&gt;, which happens when one gives the model too many tools (sometimes 2 is too many);&lt;/p&gt;</description><pubDate>Mon, 30 Jun 2025 20:59:15 +0200</pubDate><guid>https://meshrefine.com/en/posts/long-context-failures-and-fixes/</guid></item><item><title>Claude Deep Research, or How I Learned to Stop Worrying and Love Multi-Agent Systems</title><link>https://meshrefine.com/en/posts/claude_deep_research_lessons/</link><description>&lt;p&gt;I usually approach shiny new things with a healthy dose of skepticism. Until recently, this was precisely my attitude toward multi-agent systems. This is hardly surprising, given the immense hype surrounding them and the conspicuous absence of genuinely successful examples. Most implementations that actually worked fell into one of the following categories:&lt;/p&gt;
&lt;ol&gt;
&lt;li&gt;&lt;strong&gt;Agentic systems following a predefined plan.&lt;/strong&gt; These are essentially LLMs with tools, trained to automate a very specific process. This approach allows each step to be tested individually and its results verified. Such systems are typically described as a directed acyclic graph (DAG), sometimes dynamic, and developed using now-standard primitives from frameworks like LangChain and Griptape. The early implementation of Gemini Deep Research operated this way: first, a search plan was created, then the search was executed, and finally, the results were compiled.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Solutions operating in systems with a feedback loop.&lt;/strong&gt; Various Claude Code, Cursor, and other code-generating agents fall into this group. The stronger the feedback loop—that is, the better the tooling and the stricter the type checking—the greater the chance they won&amp;rsquo;t completely wreck your codebase.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Models trained using Reinforcement Learning&lt;/strong&gt;, such as those with &lt;a href="https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking#interleaved-thinking"&gt;interleaved thinking&lt;/a&gt;, like OpenAI&amp;rsquo;s o3. This is a separate, very interesting conversation, but even these models have a certain &lt;em&gt;modus operandi&lt;/em&gt; defined by the specifics of their training.&lt;/li&gt;
&lt;/ol&gt;
&lt;p&gt;Meanwhile, open-ended multi-agent systems have largely remained in the proof-of-concept stage due to their general unreliability. The community lacked a clear understanding of where and how to implement them. This was the case until Anthropic published a &lt;a href="https://www.anthropic.com/engineering/built-multi-agent-research-system"&gt;deeply technical article on how they developed their Deep Research system&lt;/a&gt;. It defined a reasonably clear framework for building such systems, and that is what we will examine today.&lt;/p&gt;</description><pubDate>Mon, 23 Jun 2025 20:26:29 +0200</pubDate><guid>https://meshrefine.com/en/posts/claude_deep_research_lessons/</guid></item><item><title>Beyond Supply and Demand: The Real Labor Pains of the AI Revolution</title><link>https://meshrefine.com/en/conversations/will_ai_take_our_jobs/</link><description>&lt;p&gt;The public conversation about AI and labor is stuck in a tedious loop. &amp;ldquo;AI will take our jobs,&amp;rdquo; declare the headlines, a statement of faith in technological determinism that serves as a conversation-stopper, not a starter. A more useful, if still imperfect, entry point begins with a simple economic model.&lt;/p&gt;
&lt;p&gt;It starts with an observation, such as Arvind Narayanan&amp;rsquo;s on radiology: AI has surpassed human performance on many discrete tasks, yet the number of human radiologists continues to grow. This suggests the dominant effect isn&amp;rsquo;t automation, but augmentation. My initial take was that this boils down to a classic supply and demand problem. One AI-augmented specialist can do the work of many, increasing supply. In fields with vast, unsaturated demand—think of the queues at hospitals or the perpetual backlogs in software development—this new capacity will simply be absorbed. Problem solved.&lt;/p&gt;</description><pubDate>Fri, 20 Jun 2025 20:31:58 +0200</pubDate><guid>https://meshrefine.com/en/conversations/will_ai_take_our_jobs/</guid></item><item><title>MCP's June Update: Safer, Smarter, Simpler?</title><link>https://meshrefine.com/en/posts/mcp_update_18_06_2025/</link><description>&lt;p&gt;The Model Context Protocol, despite its aggressive adoption (or perhaps because of it), continues to evolve. &lt;a href="https://modelcontextprotocol.io/specification/2025-06-18/changelog"&gt;Anthropic recently updated the MCP specification&lt;/a&gt;, and below, we&amp;rsquo;ll look at the main changes.&lt;/p&gt;
&lt;h2 id="0c0bef0c025560d849b4de6b55b2f23e-security-enhancements"&gt;Security Enhancements&lt;/h2&gt;
&lt;p&gt;An MCP server is now always classified as an &lt;code&gt;OAuth Resource Server&lt;/code&gt;, and clients are required to implement &lt;a href="https://www.rfc-editor.org/rfc/rfc8707.html"&gt;Resource Indicators (RFC 8707)&lt;/a&gt;. This is necessary to protect against attacks like the &lt;a href="https://en.wikipedia.org/wiki/Confused_deputy_problem"&gt;Confused Deputy&lt;/a&gt;. Previously, tokens requested by a client from an authorization server were &amp;ldquo;impersonal,&amp;rdquo; meaning they could be used by anyone. This allowed an attacker to create a phishing MCP server, deceive a client, steal the token, and use that token to gain access to the real MCP server.&lt;/p&gt;</description><pubDate>Thu, 19 Jun 2025 20:14:35 +0200</pubDate><guid>https://meshrefine.com/en/posts/mcp_update_18_06_2025/</guid></item><item><title>Blogs People Write</title><link>https://meshrefine.com/en/posts/blogs/</link><description>&lt;p&gt;At a time when the words &amp;ldquo;AI&amp;rdquo; and &amp;ldquo;hype&amp;rdquo; have become almost synonymous, it&amp;rsquo;s crucial to be smart about choosing your sources of information. There is far too much information noise out there, and sifting through the sea of articles from various AI evangelists and generated garbage to find something truly worthwhile is incredibly difficult.&lt;/p&gt;
&lt;p&gt;In this post, I&amp;rsquo;ll share the materials I read to stay up-to-date on the latest developments.&lt;/p&gt;</description><pubDate>Sun, 15 Jun 2025 15:27:48 +0200</pubDate><guid>https://meshrefine.com/en/posts/blogs/</guid></item><item><title>Poisoned Context: The Hidden Threat of Using Multiple GPTs</title><link>https://meshrefine.com/en/posts/one_gpt_vulnerability/</link><description>&lt;p&gt;It&amp;rsquo;s summer. Time to plan a vacation getaway. You open ChatGPT, select the increasingly popular &amp;ldquo;Travel Advisor&amp;rdquo; GPT, and start discussing options. The advisor gives excellent suggestions, offers fascinating details about local attractions, generates pretty good itineraries, and generally leaves a great impression. Sure, some oddities pop up here and there, but you dismiss them as harmless hallucinations. You settle on Barcelona. Excellent choice. In the same chat, you switch to another familiar and popular GPT, &amp;ldquo;Booking Agent,&amp;rdquo; which has never let you down, and book your accommodations.&lt;/p&gt;</description><pubDate>Wed, 11 Jun 2025 20:52:10 +0200</pubDate><guid>https://meshrefine.com/en/posts/one_gpt_vulnerability/</guid></item><item><title>Griptape, Part 2: Building Graphs</title><link>https://meshrefine.com/en/posts/griptape-2/</link><description>&lt;p&gt;In the &lt;a href="https://meshrefine.com/en/posts/griptape-1/"&gt;previous post&lt;/a&gt;, I broke down the basic concepts of the &lt;a href="https://www.griptape.ai"&gt;Griptape&lt;/a&gt; AI framework, and now it&amp;rsquo;s time to put them into practice. We&amp;rsquo;ll try to use them to develop a small application that helps run a link-blog on Telegram.&lt;/p&gt;
&lt;p&gt;The application will receive a URL, download its content, run it through an LLM to generate a summary, translate that summary into a couple of other languages, combine everything, and publish it to Telegram via a bot. The general flow can be seen in the diagram below:&lt;/p&gt;</description><pubDate>Thu, 05 Jun 2025 14:40:50 +0200</pubDate><guid>https://meshrefine.com/en/posts/griptape-2/</guid></item><item><title>OpenAI Codex Gains Internet Access: First Impressions</title><link>https://meshrefine.com/en/posts/openai-codex-internet-access/</link><description>&lt;h2 id="f05970d8e8e7ace55eca4844553fe66b-what-on-earth-is-codex"&gt;What on Earth is Codex?&lt;/h2&gt;
&lt;p&gt;Good question, right? The thing is, until recently, OpenAI had a model called Codex, which was used as the foundation for autocompletion in GitHub Copilot. Then, OpenAI released a console agent for development, which they named, so no one would get confused, &lt;a href="https://github.com/openai/codex"&gt;Codex&lt;/a&gt;. Everyone had a laugh at OpenAI&amp;rsquo;s naming skills , and life went on. Until the fateful day when a tweet like this appeared from Sam Altman:&lt;/p&gt;</description><pubDate>Wed, 04 Jun 2025 10:12:42 +0200</pubDate><guid>https://meshrefine.com/en/posts/openai-codex-internet-access/</guid></item><item><title>Mastering AI Crawler Control: A Guide to `robots.txt` and Advanced Webmaster Tools</title><link>https://meshrefine.com/en/conversations/robots_txt/</link><description>&lt;ul&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#1-introduction-the-imperative-of-ai-crawler-management"&gt;1. Introduction: The Imperative of AI Crawler Management&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#2-understanding-robotstxt-the-foundation-of-crawler-instruction"&gt;2. Understanding &lt;code&gt;robots.txt&lt;/code&gt;: The Foundation of Crawler Instruction&lt;/a&gt;
&lt;ul&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#21-core-syntax-and-directives"&gt;2.1. Core Syntax and Directives&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#22-file-placement-and-formatting"&gt;2.2. File Placement and Formatting&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#23-how-crawlers-interpret-robotstxt"&gt;2.3. How Crawlers Interpret &lt;code&gt;robots.txt&lt;/code&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#24-testing-your-robotstxt"&gt;2.4. Testing Your &lt;code&gt;robots.txt&lt;/code&gt;&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#3-identifying-key-crawler-types-ai-agents-vs-search-engine-bots"&gt;3. Identifying Key Crawler Types: AI Agents vs. Search Engine Bots&lt;/a&gt;
&lt;ul&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#31-distinguishing-characteristics"&gt;3.1. Distinguishing Characteristics&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#32-categories-of-ai-crawlers-and-their-user-agents"&gt;3.2. Categories of AI Crawlers and Their User Agents&lt;/a&gt;
&lt;ul&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#321-ai-crawlers-for-model-training"&gt;3.2.1. AI Crawlers for Model Training&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#322-ai-crawlers-for-live-retrieval-and-search-assistance"&gt;3.2.2. AI Crawlers for Live Retrieval and Search Assistance&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#33-standard-search-engine-crawlers-to-be-allowed"&gt;3.3. Standard Search Engine Crawlers (to be Allowed)&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#34-table-of-prominent-ai-crawler-user-agents"&gt;3.4. Table of Prominent AI Crawler User Agents&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#4-strategically-blocking-ai-crawlers-with-robotstxt"&gt;4. Strategically Blocking AI Crawlers with &lt;code&gt;robots.txt&lt;/code&gt;&lt;/a&gt;
&lt;ul&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#41-targeting-specific-ai-user-agents"&gt;4.1. Targeting Specific AI User Agents&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#42-applying-rules-to-specific-pages-or-directories"&gt;4.2. Applying Rules to Specific Pages or Directories&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#43-ensuring-search-engines-are-not-blocked-from-specific-pages"&gt;4.3. Ensuring Search Engines Are Not Blocked from Specific Pages&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#44-the-challenge-of-all-possible-ai"&gt;4.4. The Challenge of &amp;ldquo;All Possible AI&amp;rdquo;&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#5-advanced-methods-for-granular-ai-crawler-control"&gt;5. Advanced Methods for Granular AI Crawler Control&lt;/a&gt;
&lt;ul&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#51-html-meta-tags-page-level-control"&gt;5.1. HTML Meta Tags (Page-Level Control)&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#52-http-x-robots-tag-headers-server-level-page-control"&gt;5.2. HTTP &lt;code&gt;X-Robots-Tag&lt;/code&gt; Headers (Server-Level Page Control)&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#53-server-side-blocking"&gt;5.3. Server-Side Blocking&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#54-web-application-firewalls-wafs-and-content-delivery-networks-cdns"&gt;5.4. Web Application Firewalls (WAFs) and Content Delivery Networks (CDNs)&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#55-table-comparison-of-ai-crawler-control-mechanisms"&gt;5.5. Table: Comparison of AI Crawler Control Mechanisms&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#6-limitations-and-best-practices"&gt;6. Limitations and Best Practices&lt;/a&gt;
&lt;ul&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#61-robotstxt-is-a-directive-not-an-enforcement-mechanism"&gt;6.1. &lt;code&gt;robots.txt&lt;/code&gt; is a Directive, Not an Enforcement Mechanism&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#62-importance-of-regular-review-and-updates"&gt;6.2. Importance of Regular Review and Updates&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#63-testing-robotstxt-changes"&gt;6.3. Testing &lt;code&gt;robots.txt&lt;/code&gt; Changes&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#64-avoiding-common-pitfalls"&gt;6.4. Avoiding Common Pitfalls&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#65-log-file-analysis"&gt;6.5. Log File Analysis&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;li&gt;&lt;a href="https://meshrefine.com/en/conversations/robots_txt/#7-conclusion-implementing-a-robust-layered-ai-crawler-defense"&gt;7. Conclusion: Implementing a Robust, Layered AI Crawler Defense&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id="d00a339bc7cf17550bd2ec63dc4c601c-1-introduction-the-imperative-of-ai-crawler-management"&gt;1. Introduction: The Imperative of AI Crawler Management&lt;/h2&gt;
&lt;p&gt;The proliferation of Artificial Intelligence (AI) has introduced a new class of web crawlers designed to gather vast quantities of data for training Large Language Models (LLMs) and powering AI-driven applications. While these advancements offer significant potential, website operators often require precise control over which content AI crawlers can access, particularly to protect intellectual property, sensitive information, or manage server resources. Simultaneously, maintaining visibility and crawlability for traditional search engine bots like Googlebot and Bingbot remains paramount for organic search performance.&lt;/p&gt;</description><pubDate>Tue, 03 Jun 2025 12:10:59 +0200</pubDate><guid>https://meshrefine.com/en/conversations/robots_txt/</guid></item><item><title>Griptape: A Framework for AI Applications, Part 1: Introduction</title><link>https://meshrefine.com/en/posts/griptape-1/</link><description>&lt;p&gt;Today we will look at &lt;a href="www.griptape.ai"&gt;Griptape&lt;/a&gt;, a framework for building AI applications, which offers a clean Pythonic API for those tired of LangChain&amp;rsquo;s abstraction layers. It provides primitives for building assistants, RAG systems, and integrating with external tools. Honestly, in my experience, most people tired of LangChain switch to custom-written wrappers around lower-level libraries like OpenAI or LiteLLM. But who knows, maybe they&amp;rsquo;re missing out. Let&amp;rsquo;s dive in.&lt;/p&gt;
&lt;h1 id="2478e62b6bf58b4c71f48f86c1ef343f-a-bit-of-history"&gt;A Bit of History&lt;/h1&gt;
&lt;p&gt;Personally, I&amp;rsquo;ve been hearing about Griptape for about a year and a half. As far as I remember, It started as a sort of LangChain competitor with quite similar primitives, but their paths gradually diverged. As of the time of the writing, it has 2.3k stars on GitHub, which is somewhat less than LangChain&amp;rsquo;s 109k, but still enough to consider the project quite mature.
Besides the open-source framework, it has also developed its own cloud where you can run your applications, ETLs, and RAGs, and a visual builder, Griptape Nodes, allowing non-professionals to click together applications in minutes. &lt;/p&gt;</description><pubDate>Fri, 30 May 2025 18:10:07 +0200</pubDate><guid>https://meshrefine.com/en/posts/griptape-1/</guid></item><item><title>Seeed Re:Camera review, part 1</title><link>https://meshrefine.com/en/posts/re-camera-1/</link><description>&lt;h2 id="33d00f9ef47653955a41e99f4308426e-alright-here-we-go"&gt;Alright, Here We Go&lt;/h2&gt;
&lt;p&gt;I got my hands on the Re:Camera from Seeed. Essentially, it&amp;rsquo;s a small box (a cube about 4 cm per side), wrapped in a heatsink. Inside, there&amp;rsquo;s a dual-core RISC-V based MPU (&lt;strong&gt;updated:&lt;/strong&gt; only one core is visible to the system, the second one is apparently reserved for special operations), an ancient 8051 microcontroller, an OmniVision camera sensor, LEDs for illumination, Wi-Fi, BT, and, you know, all sorts of peripherals. RAM is a bit scarce, only 256 megabytes, so getting Greengrass on it will be problematic. You can connect Ethernet via a special dongle-adapter that barely stays put, but for development, there&amp;rsquo;s no point, because the camera shares its network over USB type C, and it&amp;rsquo;s easier to work that way. If you&amp;rsquo;re short on storage (and the device comes in 8 GB and 64 GB built-in storage options), you can stick in a MicroSD card. You can also stick the box to something metallic, as it has magnets on one side.&lt;/p&gt;</description><pubDate>Thu, 29 May 2025 23:10:07 +0200</pubDate><guid>https://meshrefine.com/en/posts/re-camera-1/</guid></item></channel></rss>