invalidu.com
robots.txt

Robots Exclusion Standard data for invalidu.com

Resource Scan

Scan Details

Site Domain invalidu.com
Base Domain invalidu.com
Scan Status Ok
Last Scan2024-11-15T13:28:50+00:00
Next Scan 2024-11-22T13:28:50+00:00

Last Scan

Scanned2024-11-15T13:28:50+00:00
URL https://invalidu.com/robots.txt
Response IP 82.146.46.243
Found Yes
Hash 8d4eb5c19732e7babef3c3187311483202f8bb751b29f85145e25e988083c4b2
SimHash 3d045dd88619

Groups

yandex

Rule Path
Allow /misc/*.css$
Allow /misc/*.css?
Allow /misc/*.js$
Allow /misc/*.js?
Allow /modules/*.css$
Allow /modules/*.css?
Allow /modules/*.js$
Allow /modules/*.js?
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /themes/*.css$
Allow /themes/*.css?
Allow /themes/*.js$
Allow /themes/*.js?
Allow /files/*.css$
Allow /files/*.css?
Allow /files/*.js$
Allow /files/*.js?
Disallow /files/
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /comment/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user
Disallow /user/
Disallow /users/
Disallow /contact/
Disallow /vote_up_down/
Disallow /myuserpoints/
Disallow /your-votes
Disallow /aggregator/
Disallow /comments/recent
Disallow *sort%3D
Disallow *size%3D
Disallow *?destination=
Disallow /category/
Disallow /tagadelic/
Disallow *?page=
Disallow /404
Disallow /node$
Disallow /node/
Disallow /taxonomy/
Disallow /tegi/
Disallow /cache/
Disallow /images/
Disallow *?utm_source=*
Disallow *?*
Disallow /js/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /misc/*.css$
Allow /misc/*.css?
Allow /misc/*.js$
Allow /misc/*.js?
Allow /modules/*.css$
Allow /modules/*.css?
Allow /modules/*.js$
Allow /modules/*.js?
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /themes/*.css$
Allow /themes/*.css?
Allow /themes/*.js$
Allow /themes/*.js?
Allow /files/*.css$
Allow /files/*.css?
Allow /files/*.js$
Allow /files/*.js?
Disallow /files/
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /comment/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user
Disallow /user/
Disallow /users/
Disallow /contact/
Disallow /vote_up_down/
Disallow /myuserpoints/
Disallow /your-votes
Disallow /aggregator/
Disallow /comments/recent
Disallow *sort%3D
Disallow *size%3D
Disallow *?destination=
Disallow /category/
Disallow /tagadelic/
Disallow *?page=
Disallow /404
Disallow /node$
Disallow /node/
Disallow /taxonomy/
Disallow /tegi/
Disallow /cache/
Disallow /images/
Disallow *?utm_source=*
Disallow *?*
Disallow /js/

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /misc/*.css$
Allow /misc/*.css?
Allow /misc/*.js$
Allow /misc/*.js?
Allow /modules/*.css$
Allow /modules/*.css?
Allow /modules/*.js$
Allow /modules/*.js?
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /themes/*.css$
Allow /themes/*.css?
Allow /themes/*.js$
Allow /themes/*.js?
Allow /files/*.css$
Allow /files/*.css?
Allow /files/*.js$
Allow /files/*.js?
Disallow /files/
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /comment/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user
Disallow /user/
Disallow /users/
Disallow /contact/
Disallow /vote_up_down/
Disallow /myuserpoints/
Disallow /your-votes
Disallow /aggregator/
Disallow /comments/recent
Disallow *sort%3D
Disallow *size%3D
Disallow *?destination=
Disallow /category/
Disallow /tagadelic/
Disallow *?page=
Disallow /404
Disallow /node$
Disallow /node/
Disallow /taxonomy/
Disallow /tegi/
Disallow /cache/
Disallow /images/
Disallow *?utm_source=*
Disallow *?*
Disallow /js/

Other Records

Field Value
crawl-delay 10