pistik.net
robots.txt

Robots Exclusion Standard data for pistik.net

Resource Scan

Scan Details

Site Domain pistik.net
Base Domain pistik.net
Scan Status Ok
Last Scan2024-11-11T23:05:59+00:00
Next Scan 2024-11-18T23:05:59+00:00

Last Scan

Scanned2024-11-11T23:05:59+00:00
URL https://pistik.net/robots.txt
Redirect https://www.pistik.net/robots.txt
Redirect Domain www.pistik.net
Redirect Base pistik.net
Domain IPs 185.169.68.40
Redirect IPs 185.169.68.40
Response IP 185.169.68.40
Found Yes
Hash 7ee0d2930430c53097053e6b911caddb2c2a57789f5d305858ca0dd22ee0273e
SimHash 0b7e9d7086b5

Groups

discobot
dotbot
yacybot
grapeshot
barkrowler

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 60

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.pistik.net/sitemap.xml
sitemap https://www.pistik.net/sitemap-news.xml
sitemap https://www.pistik.net/sitemap-anecdotes.xml
sitemap https://www.pistik.net/sitemap-poems.xml
sitemap https://www.pistik.net/sitemap-topics.xml
sitemap https://www.pistik.net/sitemap-videos.xml
sitemap https://www.pistik.net/sitemap-yl-games.xml
sitemap https://www.pistik.net/sitemap-quotes.xml
sitemap https://www.pistik.net/sitemap-events.xml

Comments

  • disallow selected