Log In Sign Up

artnova.site
robots.txt

Robots Exclusion Standard data for artnova.site

Resource Scan

Scan Details

Site Domain artnova.site
Base Domain artnova.site
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-14T21:22:33+00:00
Next Scan 2025-09-21T21:22:33+00:00

Last Successful Scan

Scanned2025-09-06T21:22:30+00:00
URL https://artnova.site/robots.txt
Domain IPs 2a02:4780:84:6279:371e:f9c6:e48b:2987, 2a02:4780:84:ff5f:68e2:b1fd:a363:7267, 84.32.84.227, 84.32.84.39
Response IP 77.37.75.165
Found Yes
Hash 357c72d86448bbe128f9f1126ccde46ce777cbdac4ed6c885969c130c53d597d
SimHash e00af3d4e6b5

Groups

*

Rule Path
Allow /
Allow /game/
Allow /category/
Allow /search
Disallow /admin/
Disallow /includes/
Disallow /assets/uploads/
Disallow /*.php$
Allow /index.php
Allow /pages/game.php
Allow /pages/category.php
Allow /pages/search.php
Disallow /*.log$
Disallow /*.sql$
Disallow /config.php
Disallow /install.php

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap <?php echo SITE_URL; ?>/sitemap.xml
Back to top

Comments

  • Allow important pages
  • Disallow admin and sensitive areas
  • Block access to PHP files (except allowed ones)
  • Block log files and sensitive files
  • Sitemap location
  • Crawl-delay for bots (optional)
Back to top