forum.sirumem.com
robots.txt

Robots Exclusion Standard data for forum.sirumem.com

Resource Scan

Scan Details

Site Domain forum.sirumem.com
Base Domain sirumem.com
Scan Status Ok
Last Scan2025-11-25T00:49:59+00:00
Next Scan 2025-12-25T00:49:59+00:00

Last Scan

Scanned2025-11-25T00:49:59+00:00
URL https://forum.sirumem.com/robots.txt
Domain IPs 104.21.31.4, 172.67.174.66, 2606:4700:3031::ac43:ae42, 2606:4700:3032::6815:1f04
Response IP 104.21.31.4
Found Yes
Hash f27c4cf2dd7644c2872d1183681eb7d335161463c4b88ca500a770139a0aa0c5
SimHash 2734cec8c3c7

Groups

ia_archiver

Rule Path
Allow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandex
*

Rule Path
Disallow *.js
Disallow /admin/
Disallow /clientscript/
Disallow /cpstyles/
Disallow /customavatars/
Disallow /customprofilepics/
Disallow /images/
Disallow /moderator/
Disallow /ajax.php
Disallow /attachment.php
Disallow /calendar.php
Disallow /cron.php
Disallow /editpost.php
Disallow /global.php
Disallow /image.php
Disallow /includes/
Disallow /inlinemod.php
Disallow /joinrequests.php
Disallow /login.php
Disallow /member.php
Disallow /memberlist.php
Disallow /misc.php
Disallow /moderator.php
Disallow /newattachment.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /online.php
Disallow /poll.php
Disallow /postings.php
Disallow /printthread.php
Disallow /private.php
Disallow /profile.php
Disallow /register.php
Disallow /report.php
Disallow /reputation.php
Disallow /search.php
Disallow /sendmessage.php
Disallow /showgroups.php
Disallow /subscription.php
Disallow /threadrate.php
Disallow /usercp.php
Disallow /usernote.php

Other Records

Field Value
sitemap http://forum.sirumem.com/external.php?type=RSS2
sitemap http://forum.sirumem.com/sitemap/vbulletin_sitemap_blog_0.xml.gz
sitemap http://forum.sirumem.com/sitemap/vbulletin_sitemap_cms_3.xml.gz
sitemap http://forum.sirumem.com/sitemap/vbulletin_sitemap_forum_2.xml.gz
sitemap http://forum.sirumem.com/sitemap/vbulletin_sitemap_index.xml.gz
sitemap http://forum.sirumem.com/sitemap/vbulletin_sitemap_thread_1.xml.gz
sitemap http://forum.sirumem.com/xmlsitemap.php

Comments

  • Allow Archive.org to save snapshots of everything
  • Yahoo Delay
  • Yandex
  • Sitemaps

Warnings

  • `host` is not a known field.