automationmag.com
robots.txt

Robots Exclusion Standard data for automationmag.com

Resource Scan

Scan Details

Site Domain automationmag.com
Base Domain automationmag.com
Scan Status Ok
Last Scan2024-10-30T16:29:18+00:00
Next Scan 2024-11-06T16:29:18+00:00

Last Scan

Scanned2024-10-30T16:29:18+00:00
URL https://automationmag.com/robots.txt
Domain IPs 50.56.2.116
Response IP 50.56.2.116
Found Yes
Hash 72afde7439a9962c353c7824ec9017af2610540bbbcf78b62187debccc9f8181
SimHash 626fd848e913

Groups

*

Rule Path
Disallow *?p=*
Disallow /wp-includes/
Disallow /wp-login.php
Disallow /wp-admin/*
Disallow /wp-register.php
Disallow /wp-content/themes/pubx/includes/*
Disallow */tag/*
Disallow *?s=*
Disallow /search/*

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.automationmag.com/sitemap_index.xml