ostrowite.info
robots.txt

Robots Exclusion Standard data for ostrowite.info

Resource Scan

Scan Details

Site Domain ostrowite.info
Base Domain ostrowite.info
Scan Status Ok
Last Scan2024-11-16T03:42:49+00:00
Next Scan 2024-11-23T03:42:49+00:00

Last Scan

Scanned2024-11-16T03:42:49+00:00
URL http://ostrowite.info/robots.txt
Domain IPs 77.55.142.146
Response IP 77.55.142.146
Found Yes
Hash 34bae1d5bcb6565a57b0f215a53d3733d7726d6e78a16793c1e7ad03830018d6
SimHash 0e0d5b15d735

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /vancouver-weather-gwp

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /urva5

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /ontario-tv-nswgxrq

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /4vyswi

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /leaving-criterion-tpnmlz

bingbot
googlebot
slurp

Rule Path
Disallow

Other Records

Field Value
sitemap https://ostrowite.info/vancouver-weather-gwp/sitemap.xml
sitemap https://ostrowite.info/urva5/sitemap.xml
sitemap https://ostrowite.info/ontario-tv-nswgxrq/sitemap.xml
sitemap https://ostrowite.info/4vyswi/sitemap.xml
sitemap https://ostrowite.info/leaving-criterion-tpnmlz/sitemap.xml