content.techgig.com
robots.txt

Robots Exclusion Standard data for content.techgig.com

Resource Scan

Scan Details

Site Domain content.techgig.com
Base Domain techgig.com
Scan Status Ok
Last Scan2025-10-05T18:42:22+00:00
Next Scan 2025-10-19T18:42:22+00:00

Last Scan

Scanned2025-10-05T18:42:22+00:00
URL https://content.techgig.com/robots.txt
Domain IPs 104.69.157.59, 2600:1413:5000:139e::2a5b, 2600:1413:5000:13b4::2a5b
Response IP 23.199.142.20
Found Yes
Hash d76015fb57fa495ba4b88fac8364b94f3a36a74452d027cc4e09c60666538cc2
SimHash 490c85564733

Groups

*

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

Other Records

Field Value
sitemap https://content.techgig.com/sitemap/today.xml
sitemap https://content.techgig.com/sitemap/yesterday.xml