techblogcorner.com
robots.txt

Robots Exclusion Standard data for techblogcorner.com

Resource Scan

Scan Details

Site Domain techblogcorner.com
Base Domain techblogcorner.com
Scan Status Ok
Last Scan2024-06-29T04:54:02+00:00
Next Scan 2024-07-06T04:54:02+00:00

Last Scan

Scanned2024-06-29T04:54:02+00:00
URL https://techblogcorner.com/robots.txt
Domain IPs 35.212.105.144
Response IP 35.212.105.144
Found Yes
Hash 98782369e51dd22764c0a2f367efba569aa40b6be1405a4959dff1742c731878
SimHash 69304bae56d3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /comments/feed/
Disallow /trackback/
Disallow /xmlrpc.php

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap http://techblogcorner.com/post-sitemap.xml
sitemap http://techblogcorner.com/page-sitemap.xml