joepags.com
robots.txt

Robots Exclusion Standard data for joepags.com

Resource Scan

Scan Details

Site Domain joepags.com
Base Domain joepags.com
Scan Status Ok
Last Scan2024-06-12T21:46:42+00:00
Next Scan 2024-06-19T21:46:42+00:00

Last Scan

Scanned2024-06-12T21:46:42+00:00
URL https://joepags.com/robots.txt
Domain IPs 104.16.150.108, 104.16.151.108, 2606:4700::6810:966c, 2606:4700::6810:976c
Response IP 104.16.150.108
Found Yes
Hash 694830dbd7fd62328f0c6cbe8ec9cb135fa8574339b84e0e112eae29af87b5c3
SimHash 09211887aa84

Groups

twitterbot

Rule Path
Allow /wp-content/uploads/*

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

gettrbot

Rule Path
Allow /wp-content/uploads/*

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads
Allow /wp-content/uploads/*
Disallow /wp-admin/
Disallow /cms-admin/
Disallow /go/
Disallow /wp-admin/
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow /feed
Disallow /comments
Disallow */trackback
Disallow */feed
Disallow */comments

Other Records

Field Value
sitemap https://joepags.com/sitemap_index.xml