pistik.net
robots.txt

Robots Exclusion Standard data for pistik.net

Resource Scan

Scan Details

Site Domain pistik.net
Base Domain pistik.net
Scan Status Ok
Last Scan2024-07-01T12:55:00+00:00
Next Scan 2024-07-08T12:55:00+00:00

Last Scan

Scanned2024-07-01T12:55:00+00:00
URL https://pistik.net/robots.txt
Redirect https://www.pistik.net/robots.txt
Redirect Domain www.pistik.net
Redirect Base pistik.net
Domain IPs 185.169.68.32
Redirect IPs 185.169.68.32
Response IP 185.169.68.32
Found Yes
Hash fe962620eed6da7c13f4820beb61cf27f0eadf3637a1bbcac2f17569993e1d1d
SimHash 0b3e9c608eb1

Groups

discobot
dotbot
yacybot
grapeshot
barkrowler

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 60

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.pistik.net/sitemap.xml
sitemap https://www.pistik.net/sitemap-news.xml
sitemap https://www.pistik.net/sitemap-anecdotes.xml
sitemap https://www.pistik.net/sitemap-poems.xml
sitemap https://www.pistik.net/sitemap-topics.xml
sitemap https://www.pistik.net/sitemap-videos.xml
sitemap https://www.pistik.net/sitemap-yl-games.xml
sitemap https://www.pistik.net/sitemap-quotes.xml
sitemap https://www.pistik.net/sitemap-events.xml

Comments

  • disallow selected
  • User-agent: PetalBot
  • User-agent: SemrushBot
  • User-agent: AhrefsBot