Nikhil Harithas retweetledi
Nikhil Harithas
1.4K posts

Nikhil Harithas retweetledi
Nikhil Harithas retweetledi
Nikhil Harithas retweetledi
Nikhil Harithas retweetledi

@Suhail We literally did this to our data repo at @FactoryAI with hooks! docs.factory.ai/cli/configurat…
English

It feels like someone should make a post-git-hook where it asks the AI model to look at the diff of what you changed for a merged PR and update the repo’s various readmes and other documentation to make it easier for an LLM to be able to write code and reference things faster rather than reading every single line of source code that might be relevant constantly. The agents need their own docs.
English
Nikhil Harithas retweetledi
Nikhil Harithas retweetledi

@badlogicgames @matanSF The criteria is fixed. How it decides a criteria should be skipped or not depends on the criteria in question, def tuning skipping strategy as well.
English

I just have a few questions, maybe they'll result in feedback.
- Is the set of criteria fixed or generated ad-hoc by an LLM with some guidance?
- Does an LLM decide if a criteria should be evaluated for the given codebase or is that done via heuristic? I see that some criteria are skipped in the eval, while others that don't apply to the project are evaluated
E.g. most of the ones here marked as x can't really apply to the pi-mono codebase, but are still evaluated.

English

any open source repos you'd like us to run agent readiness reports on? will do every one for the next ~24h
Factory@FactoryAI
One example of a strong, agent-ready repository is the open-source data visualization tool, Apache Superset. The full agent readiness report for this repository is
English

@badlogicgames @matanSF We're iterating fast! Appreciate any feedback you might have!
English


@travisennis It isn't! Hill climbing your readiness score will help any agent succeed in your code base 😄 None of the checks are factory specific
English

I’d like to see this not tied to a single agent/product.
Factory@FactoryAI
Introducing Agent Readiness. AI coding agents are only as effective as the environment in which they operate. Agent Readiness is a framework to measure how well a repository supports autonomous development. Scores across eight axes place each repo at one of five maturity levels.
English

@_coenen Yea totally, I guess this is also hard because "good people" could just be bad people that other bad people feel good about 😄 Spiritually i agree with your take tho
English

@hurrythas I mean generally speaking people who build bad things for the world think they’re building good things for the world, so personal morality ain’t that great of a gate…
But “fun” could probably be expanded to “is it something I enjoy and feel good about?”
English
Nikhil Harithas retweetledi
Nikhil Harithas retweetledi
Nikhil Harithas retweetledi
Nikhil Harithas retweetledi
Nikhil Harithas retweetledi

















