datatorrent.com
robots.txt

Robots Exclusion Standard data for datatorrent.com

Resource Scan

Scan Details

Site Domain datatorrent.com
Base Domain datatorrent.com
Scan Status Ok
Last Scan3/11/2025, 6:56:08 AM
Next Scan 4/10/2025, 6:56:08 AM

Last Scan

Scanned3/11/2025, 6:56:08 AM
URL https://datatorrent.com/robots.txt
Redirect https://www.datatorrent.com/robots.txt
Redirect Domain www.datatorrent.com
Redirect Base datatorrent.com
Domain IPs 104.21.12.210, 172.67.132.106, 2606:4700:3032::6815:cd2, 2606:4700:3036::ac43:846a
Redirect IPs 104.21.12.210, 172.67.132.106, 2606:4700:3032::6815:cd2, 2606:4700:3036::ac43:846a
Response IP 104.21.12.210
Found Yes
Hash 8eb06e2e746798e5e4034cf8590cc76ac09b5d7ab9699d99092abd49a7bfdcc9
SimHash 4100cc4049b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.datatorrent.com/sitemap_index.xml