recepten.se
robots.txt

Robots Exclusion Standard data for recepten.se

Resource Scan

Scan Details

Site Domain recepten.se
Base Domain recepten.se
Scan Status Ok
Last Scan2024-06-14T19:26:26+00:00
Next Scan 2024-06-21T19:26:26+00:00

Last Scan

Scanned2024-06-14T19:26:26+00:00
URL https://recepten.se/robots.txt
Redirect https://www.recepten.se/robots.txt
Redirect Domain www.recepten.se
Redirect Base recepten.se
Domain IPs 213.136.36.110, 213.136.36.112
Redirect IPs 213.136.36.110, 213.136.36.112
Response IP 213.136.36.112
Found Yes
Hash 75a897d5014250cc30205ce29598c4c9f176d191b60435f71bbbf55e4c88aa59
SimHash f904d954c3f0

Groups

*

Rule Path
Disallow /pages/

mediapartners-google

Rule Path
Allow /pages/

Other Records

Field Value
sitemap https://www.recepten.se/sitemap/sitemap.xml

Comments

  • Dont let any search engine rank the real page structure
  • But allow the Google Adsense bot