tldb.info
robots.txt

Robots Exclusion Standard data for tldb.info

Resource Scan

Scan Details

Site Domain tldb.info
Base Domain tldb.info
Scan Status Ok
Last Scan2024-10-27T22:43:24+00:00
Next Scan 2024-11-03T22:43:24+00:00

Last Scan

Scanned2024-10-27T22:43:24+00:00
URL https://tldb.info/robots.txt
Domain IPs 104.21.20.244, 172.67.194.227, 2606:4700:3033::ac43:c2e3, 2606:4700:3037::6815:14f4
Response IP 172.67.194.227
Found Yes
Hash 5e000e3aeec9aae4e768ff1526a285acd17cc987268795924443437d41392e99
SimHash e808def34f71

Groups

*

Rule Path
Allow /
Disallow /db/*/page/*?sort=
Disallow /embed.js

Other Records

Field Value
sitemap https://tldb.info/sitemap.txt
sitemap https://tldb.info/sitemap.xml
sitemap https://tldb.info/rss.xml