Log In Sign Up

bigvo.net
robots.txt

Robots Exclusion Standard data for bigvo.net

Resource Scan

Scan Details

Site Domain bigvo.net
Base Domain bigvo.net
Scan Status Ok
Last Scan2024-09-24T23:59:52+00:00
Next Scan 2024-10-01T23:59:52+00:00

Last Scan

Scanned2024-09-24T23:59:52+00:00
URL https://bigvo.net/robots.txt
Domain IPs 138.2.25.124
Response IP 138.2.25.124
Found Yes
Hash 256d028e82f96916bf130cdfd2c1d59d2ccdaa7da1dd3615b9c76fcd71968815
SimHash 72ab5800ec36

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /*wp-login.php$

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /
Disallow /

claudebot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://bigvo.net/sitemap.xml
sitemap https://bigvo.net/camp/sitemap.xml
sitemap https://bigvo.net/biotope/sitemap.xml
sitemap https://bigvo.net/fishing/sitemap.xml
sitemap https://bigvo.net/old-sitemap/old-sitemap.xml
sitemap https://bigvo.net/old-sitemap/old-image-sitemap.xml
Back to top

Comments

  • Block AI
  • Block ChatGPT
  • https://www.suzukikenichi.com/blog/you-can-block-gptbot-by-robots-txt/
  • Block ChatGPT
  • https://www.suzukikenichi.com/blog/how-to-block-chatgpt-and-common-crawl-by-robots-txt/
  • Block Common Crawl
  • Block Apple Crawl for AI training
  • Block Google AI Crawl
  • Block Claude AI Crawl
Back to top

Warnings

  • `use-agent` is not a known field.
Back to top