You hit it! I am also thinking of programatic control of DevTools so I made this:
https://github.com/devtoolcss/chrome-inspector
Though it is more about debugging CSS, I think we are on the same way: let agents use tool by scripting.
Though it is more about debugging CSS, I think we are on the same way: let agents use tool by scripting.