gadgetgig.com
robots.txt

Robots Exclusion Standard data for gadgetgig.com

Resource Scan

Scan Details

Site Domain gadgetgig.com
Base Domain gadgetgig.com
Scan Status Ok
Last Scan6/4/2025, 5:51:15 PM
Next Scan 6/11/2025, 5:51:15 PM

Last Scan

Scanned6/4/2025, 5:51:15 PM
URL https://gadgetgig.com/robots.txt
Domain IPs 104.21.71.139, 172.67.145.103, 2606:4700:3033::ac43:9167, 2606:4700:3034::6815:478b
Response IP 172.67.145.103
Found Yes
Hash fc97ed47d680082db227ac17ad3f59362e81de6eda38fbdec20c26a70ab55e72
SimHash 6905eb56cbb3

Groups

*
*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /archives/
Disallow /*?*
Disallow *?replytocom
Disallow /comments/feed/
Disallow /downloads/

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://gadgetgig.com/sitemap_index.xml

Comments

  • disallow all files in these directories

Warnings

  • 1 invalid line.