bigvolcano.net
robots.txt

Robots Exclusion Standard data for bigvolcano.net

Resource Scan

Scan Details

Site Domain bigvolcano.net
Base Domain bigvolcano.net
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-09-11T00:10:20+00:00
Next Scan 2025-09-18T00:10:20+00:00

Last Successful Scan

Scanned2025-09-03T00:09:48+00:00
URL https://bigvolcano.net/robots.txt
Domain IPs 2400:b800:6::15, 43.250.140.15
Response IP 43.250.140.15
Found Yes
Hash 39cdccf1160c21767c84b0579be8b082148a739b48a8fc3dad81868c7095d29e
SimHash 446c6948efc3

Groups

psbot

Rule Path
Disallow /

sdcresearchlabs-testbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

nutch

Rule Path
Disallow /

sbider

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

lachesis

Rule Path
Disallow /

npbot

Rule Path
Disallow /

npbot-1/2.0

Rule Path
Disallow /

linksmanager

Rule Path
Disallow /

*

Rule Path
Disallow /ftp/
Disallow /cgi-bin/
Disallow /errormsg/
Disallow /ssl/
Disallow /images/affiliates/
Disallow /images/3rdpartylogos
Disallow /images/custom/
Disallow /images/GE
Disallow /images/SlotmachineTabs
Disallow /Library/
Disallow /LOGS/
Disallow /sounds/
Disallow /SpryAssets/
Disallow /TESTS/
Disallow /tests/
Disallow /custom/birdos/
Disallow /custom/suncove/
Disallow /promos/
Disallow /shop/
Disallow /docs/archive/
Disallow /docs/infoform.htm
Disallow /docs/sitemap.htm
Disallow /docs/thanks.htm

Other Records

Field Value
sitemap https://www.bigvolcano.com.au/sitemap.xml

Comments

  • robots.txt for https://www.bigvolcano.com.au/
  • Date format dd/mm/yyyy
  • 09/04/2024
  • image bot general list starts here
  • image bot list ends here
  • uptime bots start here
  • uptime bots end here
  • general list starts here
  • general list ends
  • directed to all robots