If you found this address in your logs, one of our users pasted a link to your site and we fetched it to show them its title, description and icon.
TweezersBot/1.0 (+https://tweezers.lol/about/bot)
What it does
- It does not crawl. There is no queue and no schedule. It fetches only when somebody is looking at a form and asks for a preview of an address they typed, and it never follows the links it finds on your page.
- One request for the page itself, and up to four more looking for an icon: whatever your <link rel="icon"> declares, then /apple-touch-icon.png and /favicon.ico. It stops at the first one it can read.
- It reads at most the first 512KB of the page, gives up after five seconds, and follows at most three redirects.
- It requests HTML and images over http and https on their standard ports, and nothing else. It does not run JavaScript, submit forms, or accept cookies.
What we keep
The title, the description and the icon, so the person who pasted the link gets a card instead of a bare address. The icon is copied into our own storage rather than hotlinked, so your server is not asked for it again every time somebody scrolls past. Nothing else from the page is stored.
How to stop it
Match the user agent. In robots.txt:
User-agent: TweezersBot
Disallow: /
Two things to be straight about. This fetch happens because one of your visitors asked for it, in the moment they asked, so it behaves more like a person opening your page than like a crawler, and it does not currently read robots.txt before doing it. If you would rather it did not fetch your site at all, block the user agent at your edge or write to us and we will refuse the domain at ours.
Contact
[email protected]. A rate that bothers you, a page we read wrongly, or a request to stay away entirely: any of those is worth an email and will get an answer.