gasenginemagazine.com
robots.txt

Robots Exclusion Standard data for gasenginemagazine.com

Resource Scan

Scan Details

Site Domain gasenginemagazine.com
Base Domain gasenginemagazine.com
Scan Status Ok
Last Scan2024-09-29T08:26:41+00:00
Next Scan 2024-10-06T08:26:41+00:00

Last Scan

Scanned2024-09-29T08:26:41+00:00
URL https://gasenginemagazine.com/robots.txt
Redirect https://www.gasenginemagazine.com/robots.txt
Redirect Domain www.gasenginemagazine.com
Redirect Base gasenginemagazine.com
Domain IPs 18.155.68.113, 18.155.68.39, 18.155.68.83, 18.155.68.98
Redirect IPs 52.84.45.100, 52.84.45.49, 52.84.45.57, 52.84.45.78
Response IP 18.165.140.20
Found Yes
Hash 630c64b395fb43c126c34d47f806c72a2a682aaa28ebfe0fe3a0eda7053056bd
SimHash 83a59260dba3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /_custom/*
Disallow /*/print/
Disallow /wp-json/*
Disallow /search/*
Disallow /email
Disallow /print
Disallow /print-article.aspx
Disallow /sso/*
Disallow /store/offer/*
Disallow /store/author/*
Disallow /watch/*
Disallow /uploadedFiles/*
Disallow /tags/*
Disallow /search
Disallow /contributors/*

rogerbot

Rule Path
Allow /*
Disallow /wp-admin/
Disallow /_custom/
Disallow /wp-json/

twitterbot

Rule Path
Allow /

dotbot

Rule Path
Allow /*
Disallow /wp-admin/
Disallow /wp-json/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gasenginemagazine.com/sitemap.xml