Log In Sign Up

toxinfo.org
robots.txt

Robots Exclusion Standard data for toxinfo.org

Resource Scan

Scan Details

Site Domain toxinfo.org
Base Domain toxinfo.org
Scan Status Ok
Last Scan2024-09-21T12:31:17+00:00
Next Scan 2024-10-21T12:31:17+00:00

Last Scan

Scanned2024-09-21T12:31:17+00:00
URL https://toxinfo.org/robots.txt
Domain IPs 104.21.60.11, 172.67.186.215, 2606:4700:3031::6815:3c0b, 2606:4700:3035::ac43:bad7
Response IP 104.21.60.11
Found Yes
Hash 61a3c2a986cd966288a42edf5525400d2357b21db468082fce6f06173e8b357c
SimHash 48445c8257d2

Groups

*

Rule Path
Disallow /comments/feed
Disallow /feed/$
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow /trackback/
Disallow /wp-admin/
Disallow /*.inc$
Disallow */trackback/

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.toxinfo.org/sitemap.xml
Back to top

Warnings

  • `` is not a known field.
Back to top