<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
	<channel>
		<title>LLM Inference on itu</title>
		<link>/tags/llm-inference/</link>
		<description>Recent content in LLM Inference on itu</description>
		<generator>Hugo</generator>
		<language>en</language>
		
		
		
			<copyright>&amp;copy; 2024 itsublog. All rights reserved.
</copyright>
		
		
			<lastBuildDate>Thu, 05 Nov 2026 01:12:00 +0900</lastBuildDate>
		
			<atom:link href="/tags/llm-inference/index.xml" rel="self" type="application/rss+xml" />
			<item>
				<title>ARC Prize 2026 ARC-AGI-2: Qwen3.8-Flash-Next agent on 4 L4 GPUs</title>
				<link>/posts/projects/arc-prize-2026-arc-agi-2/</link>
				<pubDate>Thu, 05 Nov 2026 01:12:00 +0900</pubDate>
				<guid>/posts/projects/arc-prize-2026-arc-agi-2/</guid>
				<description>&lt;p&gt;This is the writeup of our solution to the Kaggle competition &lt;a href=&#34;https://www.kaggle.com/competitions/arc-prize-2026-arc-agi-2&#34;&gt;ARC Prize 2026 ARC-AGI-2&lt;/a&gt;.&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Code and the competition notebook: &lt;a href=&#34;https://github.com/itsuitsuki/arc-prize-2026-arc-agi-2&#34;&gt;itsuitsuki/arc-prize-2026-arc-agi-2&lt;/a&gt; on GitHub&lt;/li&gt;&#xA;&lt;li&gt;This writeup as a PDF: &lt;a href=&#34;/files/arc_prize_2026_writeup.pdf&#34;&gt;writeup.pdf&lt;/a&gt;&lt;/li&gt;&#xA;&lt;li&gt;The Kaggle notebook: &lt;a href=&#34;https://www.kaggle.com/code/nisshokuitsuki/arc-prize-2026-solution&#34;&gt;nisshokuitsuki/arc-prize-2026-solution&lt;/a&gt;&lt;/li&gt;&#xA;&lt;li&gt;The engine with our changes: &lt;a href=&#34;https://github.com/itsuitsuki/merlin-engine/tree/arc-v2.5.2&#34;&gt;itsuitsuki/merlin-engine&lt;/a&gt;, branch &lt;code&gt;arc-v2.5.2&lt;/code&gt;&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;h1 id=&#34;acknowledgements&#34;&gt;Acknowledgements&lt;/h1&gt;&#xA;&lt;p&gt;We thank the ARC Prize Foundation and Kaggle for hosting ARC Prize 2026.&lt;/p&gt;&#xA;&lt;p&gt;We also thank the authors of the public work we build on:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Adarsh&amp;rsquo;s notebook &lt;a href=&#34;https://www.kaggle.com/code/madarshbb/arc-qwen-3-8-27b-agent&#34;&gt;arc-qwen-3-8-27b-agent&lt;/a&gt;: the &lt;code&gt;objects()&lt;/code&gt; and &lt;code&gt;diff()&lt;/code&gt; helpers, and a submission tool, which the model can call to record the answer of a program that reproduces the training pairs.&lt;/li&gt;&#xA;&lt;li&gt;Russell Kirk&amp;rsquo;s notebook &lt;a href=&#34;https://www.kaggle.com/code/russcore/arcagi2-qwen38-freeform-direct&#34;&gt;arcagi2-qwen38-freeform-direct&lt;/a&gt; and Tufa Labs&amp;rsquo; &lt;a href=&#34;https://github.com/Tufalabs/duck-harness&#34;&gt;Duck harness&lt;/a&gt;: a harness that leaves the choice between reasoning directly and running Python to the model.&lt;/li&gt;&#xA;&lt;li&gt;NVIDIA&amp;rsquo;s &lt;a href=&#34;https://huggingface.co/datasets/nvidia/Nemotron-SFT-ARC-AGI-v1&#34;&gt;Nemotron-SFT-ARC-AGI-v1&lt;/a&gt; dataset: the name and call format of our Python tool (we have not trained on the dataset).&lt;/li&gt;&#xA;&lt;li&gt;The ARC Prize Foundation&amp;rsquo;s &lt;a href=&#34;https://github.com/arcprize/arc-agi-benchmarking&#34;&gt;arc-agi-benchmarking&lt;/a&gt;: the wording of our task prompt and the parsing of grids from the model&amp;rsquo;s answer.&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;The model stack is the work of the &lt;a href=&#34;https://huggingface.co/Qwen/Qwen3.8-Flash-Next&#34;&gt;Qwen team&lt;/a&gt; (Qwen3.8-Flash-Next), &lt;a href=&#34;https://huggingface.co/Intel/Qwen3.8-Flash-Next-W4A16-AutoRound&#34;&gt;Intel&lt;/a&gt; (W4A16 AutoRound), &lt;a href=&#34;https://huggingface.co/RadixArk/Qwen3.8-Flash-Next-NVFP4&#34;&gt;RadixArk&lt;/a&gt; and &lt;a href=&#34;https://huggingface.co/albucino/Qwen3.8-Flash-Next-W4A16-FP8PLE&#34;&gt;albucino&lt;/a&gt; (the FP8 n-gram table and the INT4 MTP drafter), &lt;a href=&#34;https://huggingface.co/AxonZeta/Qwen3.8-Flash-Next-AZ-Focus&#34;&gt;AxonZeta&lt;/a&gt; (AZ-Focus) and &lt;a href=&#34;https://www.kaggle.com/dfranzen&#34;&gt;dfranzen&lt;/a&gt; (the Kaggle copies). We serve it with halt95&amp;rsquo;s &lt;a href=&#34;https://github.com/halt95/merlin-engine&#34;&gt;Merlin engine&lt;/a&gt;, a fork of &lt;a href=&#34;https://github.com/vllm-project/vllm&#34;&gt;vLLM&lt;/a&gt;.&lt;/p&gt;</description>
			</item>
	</channel>
</rss>
