faucet.today
robots.txt

Robots Exclusion Standard data for faucet.today

Resource Scan

Scan Details

Site Domain faucet.today
Base Domain faucet.today
Scan Status Ok
Last Scan2024-11-05T19:46:32+00:00
Next Scan 2024-11-12T19:46:32+00:00

Last Scan

Scanned2024-11-05T19:46:32+00:00
URL https://faucet.today/robots.txt
Domain IPs 104.21.21.63, 172.67.196.203, 2606:4700:3034::6815:153f, 2606:4700:3035::ac43:c4cb
Response IP 172.67.196.203
Found Yes
Hash a0163db717ad2363fd81b8ab78fec62cf229a057771d40db5dabdb0989b49131
SimHash 6101d2445dd3

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://faucet.today/sitemap.xml

Warnings

  • 1 invalid line.