Log In Sign Up

anig.pro
robots.txt

Robots Exclusion Standard data for anig.pro

Resource Scan

Scan Details

Site Domain anig.pro
Base Domain anig.pro
Scan Status Ok
Last Scan2024-09-20T16:38:05+00:00
Next Scan 2024-09-27T16:38:05+00:00

Last Scan

Scanned2024-09-20T16:38:05+00:00
URL https://anig.pro/robots.txt
Domain IPs 185.104.45.159, 2a06:6440:0:2d9f::1
Response IP 185.104.45.159
Found Yes
Hash 064e2941525a3b9e949419e45b69875fb400b21fb522d46acb483849613607d9
SimHash 3711e35d4f55

Groups

*

Rule Path
Disallow /quick_search.php?sorter=0&order=2
Disallow /quick_search.php?sorter=1
Disallow /quick_search.php?sorter=2
Disallow /quick_search.php?sorter=3
Disallow /quick_search.php?sorter=4
Disallow /quick_search.php?sorter=5
Disallow /quick_search.php?sorter=6
Disallow /index.php?lang_code=
Disallow /quick_search.php?lang_code=
Disallow /news.php?lang_code=
Disallow /info.php?lang_code=
Disallow /contact.php?lang_code=
Disallow /registration.php
Disallow /login.php
Disallow /lost_pass.php
Back to top

Comments

  • Allow only one sorting order /quick_search.php?sorter=0&order=1
  • Disallow all files from the public part with lang_code parameter
  • Disallow not informative pages
Back to top