Are you using residential proxies? How do you handle websites that don't want to be scraped.

EG if I start passing in Linkedin pages what is your expectation of the result that people would see per profile.

EDIT:

Congrats on the launch seriously hard work, just wanting to understand your scraping stance more. I've worked with a lot of tools on this, didn't mean for my initial comment to be adversarial.

I was using Context back when it was still Brand.dev. I found it to be a great product- one of those rare APIs that immediately made a problem I had disappear. Had it in production within an hour of signing up

Agents need clean/current context from the web, and this is the best way I’ve found to give it to them. The internet is clearly moving in this direction: companies are starting to realize their sites need to be legible to agents. Some are already adapting but many haven’t yet. Context feels like an important part of that transition

Yahia is a great builder. His pace of expansion has been impressive, excited to see where he takes Context.

I like the clarity, tone, and readability of your webpage. Also your FAQ is refreshing

> When Should I talk to sales? > Talk to sales if you need high-volume pricing beyond 2M credits/month, custom rate limits, SSO / SAML, SCIM provisioning, an uptime SLA, annual invoicing, an MSA / DPA, or a dedicated support channel. Reach us at hello@context.dev or through the contact page.

Would that this were the norm everywhere, rather than (say) a sales rep from Datadog scraping my phone number from who knows where to ask about my company's needs after I sign up for a free account on a whim :)

Unclear what difference exists against Firecrawl - their team has been shipping great features extremely quickly lately, and their core offerings have become really good.

I am interested in KnifeGeek though - looking for a good OTF (ultratech?)

Awesome! Been great watching this product improve so quickly, can't wait for what's next :)

Does this respect llms.txt and robots.txt, or have you found it more effective if agents see what humans see?

love the design... congrats

new frontier models do this already

So basically web scraping as a service with an API on top?

Seems wildly expensive, furthermore not a single mention of "ip" on homepage? Not using rotating ip's, residential proxies?

AKA unusable for high value data.

Great, another thing I have to block server side. Reminds me of the image leech protections that had to be in place because bandwidth was expensive. History doesn’t repeat but rhymes as they say.

Nice, @grok how does it compare to Cloudflare that also provides a REST endpoint for structured markdown data and screenshots?