datamasters.it
robots.txt

Robots Exclusion Standard data for datamasters.it

Resource Scan

Scan Details

Site Domain datamasters.it
Base Domain datamasters.it
Scan Status Ok
Last Scan2026-01-19T17:31:27+00:00
Next Scan 2026-02-18T17:31:27+00:00

Last Scan

Scanned2026-01-19T17:31:27+00:00
URL https://datamasters.it/robots.txt
Domain IPs 104.26.10.86, 104.26.11.86, 172.67.74.168, 2606:4700:20::681a:a56, 2606:4700:20::681a:b56, 2606:4700:20::ac43:4aa8
Response IP 172.67.74.168
Found Yes
Hash 92a74a6c35da8c370b4c5cd1c263d08be6beb557c52b5d0c22abf53bd9baa76d
SimHash b877c8a68b52

Groups

*

Rule Path
Disallow /*?*=*

titan

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

Other Records

Field Value
sitemap https://datamasters.it/sitemap.xml