Log In Sign Up

intercon.ru
robots.txt

Robots Exclusion Standard data for intercon.ru

Resource Scan

Scan Details

Site Domain intercon.ru
Base Domain intercon.ru
Scan Status Ok
Last Scan2024-10-20T16:35:16+00:00
Next Scan 2024-11-19T16:35:16+00:00

Last Scan

Scanned2024-10-20T16:35:16+00:00
URL https://intercon.ru/robots.txt
Domain IPs 90.156.201.13, 90.156.201.34, 90.156.201.38, 90.156.201.56
Response IP 90.156.201.34
Found Yes
Hash 6d2694ec23971b725ac8e7c1b8c42b9fcc15536795374dbba2ee85aa610f4a6e
SimHash 1a16e0474f31

Groups

*

Rule Path
Allow /
Disallow /App_Data/
Disallow /App_Plugins/
Disallow /App_Browsers/
Disallow /config/
Disallow /bin/
Disallow /install
Disallow /umbraco
Disallow /offers/
Disallow /corporate/
Disallow /private/
Back to top

Other Records

Field Value
sitemap https://www.intercon.ru/sitemap.xml
Back to top

Comments

  • To add a comment to the file, start the line with the # character.
  • User-Agent is used to target a particular web crawler.
  • Any rules declared below it will apply to that User-Agent.
  • To hide a file or folder from the User-Agent, type the word 'Disallow' followed by a semi-colon.
  • Host: www.intercon.ru:443
  • Disallow: /views/
  • Disallow: /news/
Back to top