12up.com
robots.txt

Robots Exclusion Standard data for 12up.com

Resource Scan

Scan Details

Site Domain 12up.com
Base Domain 12up.com
Scan Status Ok
Last Scan2024-05-10T03:03:28+00:00
Next Scan 2024-05-17T03:03:28+00:00

Last Scan

Scanned2024-05-10T03:03:28+00:00
URL https://12up.com/robots.txt
Redirect https://www.12up.com/robots.txt
Redirect Domain www.12up.com
Redirect Base 12up.com
Domain IPs 35.83.190.225, 44.241.188.24
Redirect IPs 13.35.18.29, 13.35.18.7, 13.35.18.83, 13.35.18.92, 2600:9000:20c7:200:f:8f3b:1200:93a1, 2600:9000:20c7:5200:f:8f3b:1200:93a1, 2600:9000:20c7:8600:f:8f3b:1200:93a1, 2600:9000:20c7:9000:f:8f3b:1200:93a1, 2600:9000:20c7:b400:f:8f3b:1200:93a1, 2600:9000:20c7:c00:f:8f3b:1200:93a1, 2600:9000:20c7:cc00:f:8f3b:1200:93a1, 2600:9000:20c7:fa00:f:8f3b:1200:93a1
Response IP 13.35.18.29
Found Yes
Hash 0597cbe3b3af99893eaad5ca6bde311f92b3bd0b094e2673d88aa412bd1c3f7e
SimHash 815023146427

Groups

*

Rule Path
Disallow */xposts/

*

Rule Path
Disallow */reader/

*

Rule Path
Disallow /ads/

*

Rule Path
Disallow */editor/*
Disallow */posts/*/edit$

*

Rule Path
Disallow */posts/*/publish$

*

Rule Path
Disallow */singlepage/pipe/*
Disallow */singlepage/uncached_pipe/*
Disallow */singlepage/epipe/*

*

Rule Path
Disallow */reads/*/read$

*

Rule Path
Disallow /matches/
Disallow /es/partidos/
Disallow /it/partite/
Disallow /de/spiele/
Disallow /zh-CN/*

*

Rule Path
Disallow /ping
Disallow */sessions
Disallow */admin/*
Disallow */management
Disallow */castr
Disallow */unfeature$
Disallow */unfeature/*

*

Rule Path
Disallow /videos/
Allow /channels/videos/

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • allow adsense crawler access to all pages