robotica.pt
robots.txt

Robots Exclusion Standard data for robotica.pt

Resource Scan

Scan Details

Site Domain robotica.pt
Base Domain robotica.pt
Scan Status Ok
Last Scan2025-10-08T16:51:39+00:00
Next Scan 2025-10-15T16:51:39+00:00

Last Scan

Scanned2025-10-08T16:51:39+00:00
URL https://robotica.pt/robots.txt
Domain IPs 130.185.82.125
Response IP 130.185.82.125
Found Yes
Hash 9140dc0d4990c591648a0847310ea4095b567d4431830a5354f908ef272c160c
SimHash 69059a154713

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.robotica.pt/sitemap.xml