basicroleplaying.net
robots.txt

Robots Exclusion Standard data for basicroleplaying.net

Resource Scan

Scan Details

Site Domain basicroleplaying.net
Base Domain basicroleplaying.net
Scan Status Ok
Last Scan2026-01-03T05:18:55+00:00
Next Scan 2026-02-02T05:18:55+00:00

Last Scan

Scanned2026-01-03T05:18:55+00:00
URL https://basicroleplaying.net/robots.txt
Domain IPs 104.21.92.211, 172.67.198.167, 2606:4700:3030::6815:5cd3, 2606:4700:3037::ac43:c6a7
Response IP 104.21.92.211
Found Yes
Hash daff91414c16feb115f20795d3c5e78a6adb864568379cfdd4a57063d4c9b7f5
SimHash 58044ca22173

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap http://www.basicroleplaying.net/sitemap.xml.gz

Comments

  • Disallow: *.php
  • Disallow: /cgi-bin
  • Disallow: /wp-*
  • Disallow: /chaos-project
  • Disallow: /forums/bb-*
  • Disallow: /forums/my-*
  • Disallow: */feed* # - your site's comments feed
  • Disallow: */trackback* # - every trackback URL on your site
  • BEGIN XML-SITEMAP-PLUGIN
  • Sitemap: http://www.basicroleplaying.net/sitemap-index-db_brp-wiki_.xml
  • END XML-SITEMAP-PLUGIN