Agent BenchWe give models the same task and publish what it cost them.

Task

Find one fact buried in a long document

Retrieval over a long context. The answer is present exactly once and is unguessable.

Measured
2026-09-12 UTC
Result
6 of 6 passed
Temperature
0
Prompt size
21,796 chars
ModelResultTimeThinking tokensWhat came back
gemini-3.5-flash-litepass1,064msnot reportedfound
gemini-3.1-flash-litepass1,116msnot reportedfound
gemini-2.5-flash-litepass1,555msnot reportedfound
gemini-3.5-flashpass1,967ms221found
gemini-2.5-flashpass2,225ms81found
gemini-3-flash-previewpass2,376ms262found

What happened

Every model passed

All 6 models we could reach completed this one. The difference is not capability, it is what each spent to get there.

Thinking more did not mean getting it right

On this task gemini-3-flash-preview spent 262 thinking tokens and passed. 3 models passed without reporting a single thinking token. Six models is a small sample, so read this as what happened here, not as a law.

2.2× between fastest and slowest

gemini-3.5-flash-lite finished in 1,064ms. gemini-3-flash-preview took 2,376ms for the same prompt.

The exact prompt

Read the document and answer with the access code only.

Section 0. Routine maintenance notes for unit 100: pressure nominal, valve seated, log archived.
Section 1. Routine maintenance notes for unit 101: pressure nominal, valve seated, log archived.
Section 2. Routine maintenance notes for unit 102: pressure nominal, valve seated, log archived.
Section 3. Routine maintenance notes for unit 103: pressure nominal, valve seated, log archived.
Section 4. Routine maintenance notes for unit 104: pressure nominal, valve seated, log archived.
Section 5. Routine maintenance notes for unit 105: pressure nominal, valve seated, log archived.
Section 6. Routine maintenance notes for unit 106: pressure nominal, valve seated, log archived.
Section 7. Routine maintenance notes for unit 107: pressure nominal, valve seated, log archived.
Section 8. Routine maintenance notes for unit 108: pressure nominal, valve seated, log archived.
Section 9. Routine maintenance notes for unit 109: pressure nominal, valve seated, log archived.
Section 10. Routine maintenance notes for unit 110: pressure nominal, valve seated, log archived.
Section 11. Routine maintenance notes for unit 111: pressure nominal, valve seated, log archived.
Section 12. Routine maintenance notes for unit 112: pressure nominal, valve seated, log archived.
Section 13. Routine maintenance notes for unit 113: pressure nominal, valve seated, log archived.
Section 14. Routine maintenance notes for unit 114: pressure nominal, valve seated, log archived.
Section 15. Routine maintenance notes for unit 115: pressure nominal, valve seated, log archived.
Section 16. Routine maintenance notes for unit 116: pressure nominal, valve seated, log archived.
Section 17. Routine maintenance notes for unit 117: pressure nominal, valve seated, log archived.
Section 18. Routine maintenance notes for unit 118: pressure nominal, valve seated, log archived.
Section 19. Routine maintenance notes for unit 119: pressure nominal, valve seated, log archived.
Section 20. Routine maintenance notes for unit 120: pressure nominal, valve seated, log archived.
Section 21. Routine maintenance notes for unit 121: pressure nominal, valve seated, log archived.
Section 22. Routine maintenance notes for unit 122: pressure nominal, valve seated, log archived.
Section 23. Routine maintenance notes for unit 123: pressure nominal, valve seated, log archived.
Section 24. Routine maintenance notes for unit 124: pressure nominal, valve seated, log archived.
Section 25. Routine maintenance notes for unit 125: pressure nominal, valve seated, log archived.
Section 26. Routine maintenance notes for unit 126: pressure nominal, valve seated, log archived.
Section 27. Routine maintenance notes for unit 127: pressure nominal, valve seated, log archived.
Section 28. Routine maintenance notes for unit 128: pressure nominal, valve seated, log archived.
Section 29. Routine maintenance notes for unit 129: pressure nominal, valve seated, log archived.
Section 30. Routine maintenance notes for unit 130: pressure nominal, valve seated, log archived.
Section 31. Routine maintenance notes for unit 131: pressure nominal, valve seated, log archived.
Section 32. Routine maintenance notes for unit 132: pressure nominal, valve seated, log archived.
Section 33. Routine maintenance notes for unit 133: pressure nominal, valve seated, log archived.
Section 34. Routine maintenance notes for unit 134: pressure nominal, valve seated, log archived.
Section 35. Routine maintenance notes for unit 135: pressure nominal, valve seated, log archived.
Section 36. Routine maintenance notes for unit 136: pressure nominal, valve seated, log archived.
Section 37. Routine maintenance notes for unit 137: pressure nominal, valve seated, log archived.
Section 38. Routine maintenance notes for unit 138: pressure nominal, valve seated, log archived.
Section 39. Routine maintenance notes for unit 139: pressure nominal, valve seated, log archived.
Section 40. Routine maintenance notes for unit 140: pressure nominal, valve seated, log archived.
Section 41. Routine maintenance notes for unit 141: pressure nominal, valve seated, log archived.
Section 42. Routine maintenance notes for unit 142: pressure nominal, valve seated, log archived.
Section 43. Routine maintenance notes for unit 143: pressure nominal, valve seated, log archived.
Section 44. Routine maintenance notes for unit 144: pressure nominal, valve seated, log archived.
Section 45. Routine maintenance notes for unit 145: pressure nominal, valve seated, log archived.
Section 46. Routine maintenance notes for unit 146: pressure nominal, valve seated, log archived.
Section 47. Routine maintenance notes for unit 147: pressure nominal, valve seated, log archived.
Section 48. Routine maintenance notes for unit 148: pressure nominal, valve seated, log archived.
Section 49. Routine maintenance notes for unit 149: pressure nominal, valve seated, log archived.
Section 50. Routine maintenance notes for unit 150: pressure nominal, valve seated, log archived.
Section 51. Routine maintenance notes for unit 151: pressure nominal, valve seated, log archived.
Section 52. Routine maintenance notes for unit 152: pressure nominal, valve seated, log archived.
Section 53. Routine maintenance notes for unit 153: pressure nominal, valve seated, log archived.
Section 54. Routine maintenance notes for unit 154: pressure nominal, valve seated, log archived.
Section 55. Routine maintenance notes for unit 155: pressure nominal, valve seated, log archived.
Section 56. Routine maintenance notes for unit 156: pressure nominal, valve seated, log archived.
Section 57. Routine maintenance notes for unit 157: pressure nominal, valve seated, log archived.
Section 58. Routine maintenance notes for unit 158: pressure nominal, valve seated, log archived.
Section 59. Routine maintenance notes for unit 159: pressure nominal, valve seated, log archived.
Section 60. Routine maintenance notes for unit 160: pressure nominal, valve seated, log archived.
Section 61. Routine maintenance notes for unit 161: pressure nominal, valve seated, log archived.
Section 62. Routine maintenance notes for unit 162: pressure nominal, valve seated, log archived.
Section 63. Routine maintenance notes for unit 163: pressure nominal, valve seated, log archived.
Section 64. Routine maintenance notes for unit 164: pressure nominal, valve seated, log archived.
Section 65. Routine maintenance notes for unit 165: pressure nominal, valve seated, log archived.
Section 66. Routine maintenance notes for unit 166: pressure nominal, valve seated, log archived.
Section 67. Routine maintenance notes for unit 167: pressure nominal, valve seated, log archived.
Section 68. Routine maintenance notes for unit 168: pressure nominal, valve seated, log archived.
Section 69. Routine maintenance notes for unit 169: pressure nominal, valve seated, log archived.
Section 70. Routine maintenance notes for unit 170: pressure nominal, valve seated, log archived.
Section 71. Routine maintenance notes for unit 171: pressure nominal, valve seated, log archived.
Section 72. Routine maintenance notes for unit 172: pressure nominal, valve seated, log archived.
Section 73. Routine maintenance notes for unit 173: pressure nominal, valve seated, log archived.
Section 74. Routine maintenance notes for unit 174: pressure nominal, valve seated, log archived.
Section 75. Routine maintenance notes for unit 175: pressure nominal, valve seated, log archived.
Section 76. Routine maintenance notes for unit 176: pressure nominal, valve seated, log archived.
Section 77. Routine maintenance notes for unit 177: pressure nominal, valve seated, log archived.
Section 78. Routine maintenance notes for unit 178: pressure nominal, valve seated, log archived.
Section 79. Routine maintenance notes for unit 179: pressure nominal, valve seated, log archived.
Section 80. Routine maintenance notes for unit 180: pressure nominal, valve seated, log archived.
Section 81. Routine maintenance notes for unit 181: pressure nominal, valve seated, log archived.
Section 82. Routine maintenance notes for unit 182: pressure nominal, valve seated, log archived.
Section 83. Routine maintenance notes for unit 183: pressure nominal, valve seated, log archived.
Section 84. Routine maintenance notes for unit 184: pressure nominal, valve seated, log archived.
Section 85. Routine maintenance notes for unit 185: pressure nominal, valve seated, log archived.
Section 86. Routine maintenance notes for unit 186: pressure nominal, valve seated, log archived.
Section 87. Routine maintenance notes for unit 187: pressure nominal, valve seated, log archived.
Section 88. Routine maintenance notes for unit 188: pressure nominal, valve seated, log archived.
Section 89. Routine maintenance notes for unit 189: pressure nominal, valve seated, log archived.
Section 90. Routine maintenance notes for unit 190: pressure nominal, valve seated, log archived.
Section 91. Routine maintenance notes for unit 191: pressure nominal, valve seated, log archived.
Section 92. Routine maintenance notes for unit 192: pressure nominal, valve seated, log archived.
Section 93. Routine maintenance notes for unit 193: pressure nominal, valve seated, log archived.
Section 94. Routine maintenance notes for unit 194: pressure nominal, valve seated, log archived.
Section 95. Routine maintenance notes for unit 195: pressure nominal, valve seated, log archived.
Section 96. Routine maintenance notes for unit 196: pressure nominal, valve seated, log archived.
Section 97. Routine maintenance notes for unit 197: pressure nominal, valve seated, log archived.
Section 98. Routine maintenance notes for unit 198: pressure nominal, valve seated, log archived.
Section 99. Routine maintenance notes for unit 199: pressure nominal, valve seated, log archived.
Section 100. Routine maintenance notes for unit 200: pressure nominal, valve seated, log archived.
Section 101. Routine maintenance notes for unit 201: pressure nominal, valve seated, log archived.
Section 102. Routine maintenance notes for unit 202: pressure nominal, valve seated, log archived.
Section 103. Routine maintenance notes for unit 203: pressure nominal, valve seated, log archived.
Section 104. Routine maintenance notes for unit 204: pressure nominal, valve seated, log archived.
Section 105. Routine maintenance notes for unit 205: pressure nominal, valve seated, log archived.
Section 106. Routine maintenance notes for unit 206: pressure nominal, valve seated, log archived.
Section 107. Routine maintenance notes for unit 207: pressure nominal, valve seated, log archived.
Section 108. Routine maintenance notes for unit 208: pressure nominal, valve seated, log archived.
Section 109. Routine maintenance notes for unit 209: pressure nominal, valve seated, log archived.
Section 110. The access code is MAPLE-7731.
Section 110. Routine maintenance notes for unit 210: pressure nominal, valve seated, log archived.
Section 111. Routine maintenance notes for unit 211: pressure nominal, valve seated, log archived.
Section 112. Routine maintenance notes for unit 212: pressure nominal, valve seated, log archived.
Section 113. Routine maintenance notes for unit 213: pressure nominal, valve seated, log archived.
Section 114. Routine maintenance notes for unit 214: pressure nominal, valve seated, log archived.
Section 115. Routine maintenance notes for unit 215: pressure nominal, valve seated, log archived.
Section 116. Routine maintenance notes for unit 216: pressure nominal, valve seated, log archived.
Section 117. Routine maintenance notes for unit 217: pressure nominal, valve seated, log archived.
Section 118. Routine maintenance notes for unit 218: pressure nominal, valve seated, log archived.
Section 119. Routine maintenance notes for unit 219: pressure nominal, valve seated, log archived.
Section 120. Routine maintenance notes for unit 220: pressure nominal, valve seated, log archived.
Section 121. Routine maintenance notes for unit 221: pressure nominal, valve seated, log archived.
Section 122. Routine maintenance notes for unit 222: pressure nominal, valve seated, log archived.
Section 123. Routine maintenance notes for unit 223: pressure nominal, valve seated, log archived.
Section 124. Routine maintenance notes for unit 224: pressure nominal, valve seated, log archived.
Section 125. Routine maintenance notes for unit 225: pressure nominal, valve seated, log archived.
Section 126. Routine maintenance notes for unit 226: pressure nominal, valve seated, log archived.
Section 127. Routine maintenance notes for unit 227: pressure nominal, valve seated, log archived.
Section 128. Routine maintenance notes for unit 228: pressure nominal, valve seated, log archived.
Section 129. Routine maintenance notes for unit 229: pressure nominal, valve seated, log archived.
Section 130. Routine maintenance notes for unit 230: pressure nominal, valve seated, log archived.
Section 131. Routine maintenance notes for unit 231: pressure nominal, valve seated, log archived.
Section 132. Routine maintenance notes for unit 232: pressure nominal, valve seated, log archived.
Section 133. Routine maintenance notes for unit 233: pressure nominal, valve seated, log archived.
Section 134. Routine maintenance notes for unit 234: pressure nominal, valve seated, log archived.
Section 135. Routine maintenance notes for unit 235: pressure nominal, valve seated, log archived.
Section 136. Routine maintenance notes for unit 236: pressure nominal, valve seated, log archived.
Section 137. Routine maintenance notes for unit 237: pressure nominal, valve seated, log archived.
Section 138. Routine maintenance notes for unit 238: pressure nominal, valve seated, log archived.
Section 139. Routine maintenance notes for unit 239: pressure nominal, valve seated, log archived.
Section 140. Routine maintenance notes for unit 240: pressure nominal, valve seated, log archived.
Section 141. Routine maintenance notes for unit 241: pressure nominal, valve seated, log archived.
Section 142. Routine maintenance notes for unit 242: pressure nominal, valve seated, log archived.
Section 143. Routine maintenance notes for unit 243: pressure nominal, valve seated, log archived.
Section 144. Routine maintenance notes for unit 244: pressure nominal, valve seated, log archived.
Section 145. Routine maintenance notes for unit 245: pressure nominal, valve seated, log archived.
Section 146. Routine maintenance notes for unit 246: pressure nominal, valve seated, log archived.
Section 147. Routine maintenance notes for unit 247: pressure nominal, valve seated, log archived.
Section 148. Routine maintenance notes for unit 248: pressure nominal, valve seated, log archived.
Section 149. Routine maintenance notes for unit 249: pressure nominal, valve seated, log archived.
Section 150. Routine maintenance notes for unit 250: pressure nominal, valve seated, log archived.
Section 151. Routine maintenance notes for unit 251: pressure nominal, valve seated, log archived.
Section 152. Routine maintenance notes for unit 252: pressure nominal, valve seated, log archived.
Section 153. Routine maintenance notes for unit 253: pressure nominal, valve seated, log archived.
Section 154. Routine maintenance notes for unit 254: pressure nominal, valve seated, log archived.
Section 155. Routine maintenance notes for unit 255: pressure nominal, valve seated, log archived.
Section 156. Routine maintenance notes for unit 256: pressure nominal, valve seated, log archived.
Section 157. Routine maintenance notes for unit 257: pressure nominal, valve seated, log archived.
Section 158. Routine maintenance notes for unit 258: pressure nominal, valve seated, log archived.
Section 159. Routine maintenance notes for unit 259: pressure nominal, valve seated, log archived.
Section 160. Routine maintenance notes for unit 260: pressure nominal, valve seated, log archived.
Section 161. Routine maintenance notes for unit 261: pressure nominal, valve seated, log archived.
Section 162. Routine maintenance notes for unit 262: pressure nominal, valve seated, log archived.
Section 163. Routine maintenance notes for unit 263: pressure nominal, valve seated, log archived.
Section 164. Routine maintenance notes for unit 264: pressure nominal, valve seated, log archived.
Section 165. Routine maintenance notes for unit 265: pressure nominal, valve seated, log archived.
Section 166. Routine maintenance notes for unit 266: pressure nominal, valve seated, log archived.
Section 167. Routine maintenance notes for unit 267: pressure nominal, valve seated, log archived.
Section 168. Routine maintenance notes for unit 268: pressure nominal, valve seated, log archived.
Section 169. Routine maintenance notes for unit 269: pressure nominal, valve seated, log archived.
Section 170. Routine maintenance notes for unit 270: pressure nominal, valve seated, log archived.
Section 171. Routine maintenance notes for unit 271: pressure nominal, valve seated, log archived.
Section 172. Routine maintenance notes for unit 272: pressure nominal, valve seated, log archived.
Section 173. Routine maintenance notes for unit 273: pressure nominal, valve seated, log archived.
Section 174. Routine maintenance notes for unit 274: pressure nominal, valve seated, log archived.
Section 175. Routine maintenance notes for unit 275: pressure nominal, valve seated, log archived.
Section 176. Routine maintenance notes for unit 276: pressure nominal, valve seated, log archived.
Section 177. Routine maintenance notes for unit 277: pressure nominal, valve seated, log archived.
Section 178. Routine maintenance notes for unit 278: pressure nominal, valve seated, log archived.
Section 179. Routine maintenance notes for unit 279: pressure nominal, valve seated, log archived.
Section 180. Routine maintenance notes for unit 280: pressure nominal, valve seated, log archived.
Section 181. Routine maintenance notes for unit 281: pressure nominal, valve seated, log archived.
Section 182. Routine maintenance notes for unit 282: pressure nominal, valve seated, log archived.
Section 183. Routine maintenance notes for unit 283: pressure nominal, valve seated, log archived.
Section 184. Routine maintenance notes for unit 284: pressure nominal, valve seated, log archived.
Section 185. Routine maintenance notes for unit 285: pressure nominal, valve seated, log archived.
Section 186. Routine maintenance notes for unit 286: pressure nominal, valve seated, log archived.
Section 187. Routine maintenance notes for unit 287: pressure nominal, valve seated, log archived.
Section 188. Routine maintenance notes for unit 288: pressure nominal, valve seated, log archived.
Section 189. Routine maintenance notes for unit 289: pressure nominal, valve seated, log archived.
Section 190. Routine maintenance notes for unit 290: pressure nominal, valve seated, log archived.
Section 191. Routine maintenance notes for unit 291: pressure nominal, valve seated, log archived.
Section 192. Routine maintenance notes for unit 292: pressure nominal, valve seated, log archived.
Section 193. Routine maintenance notes for unit 293: pressure nominal, valve seated, log archived.
Section 194. Routine maintenance notes for unit 294: pressure nominal, valve seated, log archived.
Section 195. Routine maintenance notes for unit 295: pressure nominal, valve seated, log archived.
Section 196. Routine maintenance notes for unit 296: pressure nominal, valve seated, log archived.
Section 197. Routine maintenance notes for unit 297: pressure nominal, valve seated, log archived.
Section 198. Routine maintenance notes for unit 298: pressure nominal, valve seated, log archived.
Section 199. Routine maintenance notes for unit 299: pressure nominal, valve seated, log archived.
Section 200. Routine maintenance notes for unit 300: pressure nominal, valve seated, log archived.
Section 201. Routine maintenance notes for unit 301: pressure nominal, valve seated, log archived.
Section 202. Routine maintenance notes for unit 302: pressure nominal, valve seated, log archived.
Section 203. Routine maintenance notes for unit 303: pressure nominal, valve seated, log archived.
Section 204. Routine maintenance notes for unit 304: pressure nominal, valve seated, log archived.
Section 205. Routine maintenance notes for unit 305: pressure nominal, valve seated, log archived.
Section 206. Routine maintenance notes for unit 306: pressure nominal, valve seated, log archived.
Section 207. Routine maintenance notes for unit 307: pressure nominal, valve seated, log archived.
Section 208. Routine maintenance notes for unit 308: pressure nominal, valve seated, log archived.
Section 209. Routine maintenance notes for unit 309: pressure nominal, valve seated, log archived.
Section 210. Routine maintenance notes for unit 310: pressure nominal, valve seated, log archived.
Section 211. Routine maintenance notes for unit 311: pressure nominal, valve seated, log archived.
Section 212. Routine maintenance notes for unit 312: pressure nominal, valve seated, log archived.
Section 213. Routine maintenance notes for unit 313: pressure nominal, valve seated, log archived.
Section 214. Routine maintenance notes for unit 314: pressure nominal, valve seated, log archived.
Section 215. Routine maintenance notes for unit 315: pressure nominal, valve seated, log archived.
Section 216. Routine maintenance notes for unit 316: pressure nominal, valve seated, log archived.
Section 217. Routine maintenance notes for unit 317: pressure nominal, valve seated, log archived.
Section 218. Routine maintenance notes for unit 318: pressure nominal, valve seated, log archived.
Section 219. Routine maintenance notes for unit 319: pressure nominal, valve seated, log archived.

What is the access code?

Pass/fail is decided by code, not by reading the answer. The check for this task is in bench/tasks.mjs, and failed responses are stored verbatim so the verdict can be re-read.