Skip to content
FellIntoA CONSIDERATE GUEST ON YOUR WEBSITE
FOR THE PEOPLE WHO MAKE THE WEB

Hello,
website builder.

The internet is bigger than anyone’s feed.
Thank you for making a corner of it your own.

The bespectacled FellInto Professor reading papers while riding a friendly spider.
A CONSIDERATE GUEST

Meet FellIntoBot.

FellInto helps people find free, engaging independent websites: art, games, niche knowledge, and personal obsessions. Our planned crawler will discover URLs through curated lists, nominations, and links on eligible sites.

User-Agent: FellIntoBot/1.0 (+https://fellinto.com/bot)

Take only what we need.

Start with permitted HTML. Render candidate pages to capture their appearance, with limits on requests, bytes, time, and media. No automatic full-video downloads or endless scrolling.

Remember the visit.

Save completed work durably, reuse captured evidence, and use conditional requests on revisits where supported. A model update should not make us download your site again.

Leave room for your visitors.

Use conservative per-site budgets, respect Retry-After, and slow down on errors or signs of strain. Numerical limits and revisit intervals are listed below. Missing settings must be completed before public crawling begins.

Look, then explain.

Every assessed page needs screenshot evidence or an explicit capture-failure record. Original captures stay internal as assessment evidence. We plan to publish selected, resized screenshots as directory and page-detail previews that link to the original site. Creator restrictions and removal requests apply to previews too, and restricted-content previews will require the same opt-in as their destinations.

CHECK THE GUEST LIST

Is that really our spider?

A User-Agent is a label, not proof of identity. Compare the source IP in your server logs with our published outbound addresses. We cannot verify a visit from a User-Agent alone.

  • 97.88.210.205

These addresses are configured by our operator; this page does not monitor crawler activity.

Machine-readable IP list · Crawl status and policy settings

Published operating limits

Initial page ceiling per site
10 pages
Request ceiling per site / batch
160 requests
Response-byte ceiling per site / batch
20971520 bytes
Minimum time between requests to a site
5 seconds
Maximum time per page visit
180 seconds
Routine freshness-check interval
30 days
Private evidence retention
30 days

These are configuration values, not measurements of current traffic. Requests and bytes include permission checks, retries and page assets. A stricter site-provided delay takes priority. Tablet and phone screenshots are additional views of the same bounded visit.

YOUR SITE, YOUR SAY

You choose whether we visit.

To disallow FellIntoBot across your site, put this group in your robots.txt file at the root of the relevant origin:

User-agent: FellIntoBot
Disallow: /

Our crawler must respect robots.txt, applicable indexing directives, and explicit creator restrictions, including restrictions expressed in llms.txt. Robots permission and permission to publish are separate. We will not use a blocked page as a reason to try another route around your restriction.

Stopping crawling does not itself remove previously published records. For removal, hidden previews, corrections or a slower revisit, contact us below. Robots.txt does not make a URL private; protect private material with authentication.

No ranking purchase, account, or site redesign will be required to ask for a correction. Unconventional websites are welcome.

MAKE SOMETHING WORTH FINDING

A small, useful bookshelf.

Free resources from the people who document the web. Use what helps your visitors; keep what makes your site yours.

Build your little corner

MDN’s web development lessons cover HTML, CSS, and the foundations of useful websites.

MDN web development ↗

Give your readers a feed

The RSS specification explains the format behind a simple, portable way to follow updates.

RSS specification ↗
SMALL FOOTPRINT, CLEAR INTENTIONS

Data and AI.

This information page has no advertising, analytics scripts, cookies or browser preference profile. The separate contact form is linked below when available. Its artwork and fonts are hosted with the page. Our hosting network processes ordinary connection information to deliver it; infrastructure logging and retention must be reviewed when we deploy publicly.

Our planned review process uses AI to interpret captured public pages and screenshots, including third-party inference where configured. A review is an interpretation and can be wrong. Versions and evidence help us investigate corrections. We do not ask you to provide visitor profiles or private website access.

Messages submitted through our contact form are encrypted into a private postbox for collection by our local system. Submitting does not send email. Include only information needed to address your request.

A HUMAN AT THE OTHER END

Your site, your say.

For crawler problems, removal, hidden previews, corrections or a slower revisit, leave a message through our private contact form.

No account or payment is required. A message is collected for human review; it does not automatically verify ownership or change a crawl decision. Include the affected URL and the change you need.

Download the robots.txt opt-out example. Merge this group into your existing robots.txt; do not replace unrelated rules.