pigspin.app
robots.txt

Robots Exclusion Standard data for pigspin.app

Resource Scan

Scan Details

Site Domain pigspin.app
Base Domain pigspin.app
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-17T22:44:29+00:00
Next Scan 2024-06-16T22:44:29+00:00

Last Successful Scan

Scanned2024-03-26T22:43:07+00:00
URL https://pigspin.app/robots.txt
Domain IPs 104.26.4.196, 104.26.5.196, 172.67.70.208, 2606:4700:20::681a:4c4, 2606:4700:20::681a:5c4, 2606:4700:20::ac43:46d0
Response IP 104.26.4.196
Found Yes
Hash 0f6b09cce1a3620050af814a36bc46512ee6efa31038f713bc29503da2c01728
SimHash 5d053b334933

Groups

*

Rule Path
Allow /
Allow /blog/wp-content/uploads/
Disallow /blog/wp-login.php
Disallow /blog/wp-register.php
Disallow /blog/wp-admin/
Disallow /blog/wp-content/plugins/
Disallow /blog/author/
Disallow /blog*/feed
Disallow /blog*/rss
Disallow /blog/author/
Disallow /blog/feed/
Disallow /blog/feed/$
Disallow /blog/comments/feed
Disallow /blog/trackback/
Disallow /blog/*/?author=*
Disallow /blog/*/author/*
Disallow /blog/author*
Disallow /blog/author/
Disallow /blog/*/comments$
Disallow /blog/*/feed
Disallow /blog/*/feed$
Disallow /blog/*/trackback
Disallow /blog/*/trackback$
Disallow /blog/?feed=
Disallow /blog/wp-comments
Disallow /blog/wp-feed
Disallow /blog/wp-trackback
Disallow /blog/*/replytocom%3D

Other Records

Field Value
sitemap https://pigspin.ing/sitemap.xml
sitemap https://pigspin.ing/server-sitemap.xml
sitemap https://pigspin.ing/blog/post-sitemap.xml
sitemap https://pigspin.ing/blog/category-sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.