porestina.info
robots.txt

Robots Exclusion Standard data for porestina.info

Resource Scan

Scan Details

Site Domain porestina.info
Base Domain porestina.info
Scan Status Ok
Last Scan2024-09-27T01:13:39+00:00
Next Scan 2024-10-04T01:13:39+00:00

Last Scan

Scanned2024-09-27T01:13:39+00:00
URL https://porestina.info/robots.txt
Domain IPs 104.21.23.228, 172.67.214.30, 2606:4700:3031::6815:17e4, 2606:4700:3031::ac43:d61e
Response IP 104.21.23.228
Found Yes
Hash bdc61bc64943090d4199834932c7e78e845238a57f3d21d12a98ed5034ae7c2e
SimHash 690898168791

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://porestina.info/sitemap.xml
sitemap https://porestina.info/feed