Log In Sign Up

reportacrime.org
robots.txt

Robots Exclusion Standard data for reportacrime.org

Resource Scan

Scan Details

Site Domain reportacrime.org
Base Domain reportacrime.org
Scan Status Ok
Last Scan2025-09-08T08:05:33+00:00
Next Scan 2025-10-08T08:05:33+00:00

Last Scan

Scanned2025-09-08T08:05:33+00:00
URL https://reportacrime.org/robots.txt
Domain IPs 104.21.2.198, 172.67.129.154, 2606:4700:3035::ac43:819a, 2606:4700:3036::6815:2c6
Response IP 104.21.2.198
Found Yes
Hash 7e35caf30fd599a07112a6555fe013fe8dabe88f4ee12e25b4f3388e56d6b320
SimHash 50847ed0c6f8

Groups

yandex

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there
Allow *.js -
Allow *.css -
Allow /misc/*.css$ -
Allow /misc/*.css? -
Allow /misc/*.js$ -
Allow /misc/*.js? -
Allow /misc/*.gif -
Allow /misc/*.jpg -
Allow /misc/*.jpeg -
Allow /misc/*.png -
Allow /modules/*.css$ -
Allow /modules/*.css? -
Allow /modules/*.js$ -
Allow /modules/*.js? -
Allow /modules/*.gif -
Allow /modules/*.jpg -
Allow /modules/*.jpeg -
Allow /modules/*.png -
Allow /profiles/*.css$ -
Allow /profiles/*.css? -
Allow /profiles/*.js$ -
Allow /profiles/*.js? -
Allow /profiles/*.gif -
Allow /profiles/*.jpg -
Allow /profiles/*.jpeg -
Allow /profiles/*.png -
Allow /themes/*.css$ -
Allow /themes/*.css? -
Allow /themes/*.js$ -
Allow /themes/*.js? -
Allow /themes/*.gif -
Allow /themes/*.jpg -
Allow /themes/*.jpeg -
Allow /themes/*.png -
Disallow /includes/ -
Disallow /misc/ -
Disallow /modules/ -
Disallow /profiles/ -
Disallow /scripts/ -
Disallow /themes/ -
Disallow /CHANGELOG.txt -
Disallow /cron.php -
Disallow /INSTALL.mysql.txt -
Disallow /INSTALL.pgsql.txt -
Disallow /INSTALL.sqlite.txt -
Disallow /install.php -
Disallow /INSTALL.txt -
Disallow /LICENSE.txt -
Disallow /MAINTAINERS.txt -
Disallow /update.php -
Disallow /UPGRADE.txt -
Disallow /xmlrpc.php -
Disallow /admin/ -
Disallow /comment/reply/ -
Disallow /filter/tips/ -
Disallow /node/add/ -
Disallow /search/ -
Disallow /user/register/ -
Disallow /user/password/ -
Disallow /user/login/ -
Disallow /user/logout/ -
Disallow /?q=admin%2F -
Disallow /?q=comment%2Freply%2F -
Disallow /?q=filter%2Ftips%2F -
Disallow /?q=node%2Fadd%2F -
Disallow /?q=search%2F -
Disallow /?q=user%2Fpassword%2F -
Disallow /?q=user%2Fregister%2F -
Disallow /?q=user%2Flogin%2F -
Disallow /?q=user%2Flogout%2F -

googlebot

Rule Path
Disallow
Allow *.js
Allow *.css
Allow /misc/*.css$
Allow /misc/*.css?
Allow /misc/*.js$
Allow /misc/*.js?
Allow /misc/*.gif
Allow /misc/*.jpg
Allow /misc/*.jpeg
Allow /misc/*.png
Allow /modules/*.css$
Allow /modules/*.css?
Allow /modules/*.js$
Allow /modules/*.js?
Allow /modules/*.gif
Allow /modules/*.jpg
Allow /modules/*.jpeg
Allow /modules/*.png
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /profiles/*.gif
Allow /profiles/*.jpg
Allow /profiles/*.jpeg
Allow /profiles/*.png
Allow /themes/*.css$
Allow /themes/*.css?
Allow /themes/*.js$
Allow /themes/*.js?
Allow /themes/*.gif
Allow /themes/*.jpg
Allow /themes/*.jpeg
Allow /themes/*.png
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F

mediapartners-google*
teoma

Rule Path
Disallow

w3c-checklink
wdg_sitevalidator

Rule Path
Disallow /

*

Rule Path
Allow /misc/*.css$
Allow /misc/*.css?
Allow /misc/*.js$
Allow /misc/*.js?
Allow /misc/*.gif
Allow /misc/*.jpg
Allow /misc/*.jpeg
Allow /misc/*.png
Allow /modules/*.css$
Allow /modules/*.css?
Allow /modules/*.js$
Allow /modules/*.js?
Allow /modules/*.gif
Allow /modules/*.jpg
Allow /modules/*.jpeg
Allow /modules/*.png
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /profiles/*.gif
Allow /profiles/*.jpg
Allow /profiles/*.jpeg
Allow /profiles/*.png
Allow /themes/*.css$
Allow /themes/*.css?
Allow /themes/*.js$
Allow /themes/*.js?
Allow /themes/*.gif
Allow /themes/*.jpg
Allow /themes/*.jpeg
Allow /themes/*.png
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F

Other Records

Field Value
crawl-delay 10

ia_archiver

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.reportacrime.org/sitemap.xml
Back to top

Comments

  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
Back to top

Warnings

  • 1 invalid line.
  • `host` is not a known field.
Back to top