solunion.mx
robots.txt

Robots Exclusion Standard data for solunion.mx

Resource Scan

Scan Details

Site Domain solunion.mx
Base Domain solunion.mx
Scan Status Ok
Last Scan2024-09-07T08:02:22+00:00
Next Scan 2024-10-07T08:02:22+00:00

Last Scan

Scanned2024-09-07T08:02:22+00:00
URL https://solunion.mx/robots.txt
Redirect https://www.solunion.mx/robots.txt
Redirect Domain www.solunion.mx
Redirect Base solunion.mx
Domain IPs 77.240.112.10
Redirect IPs 77.240.112.10
Response IP 77.240.112.10
Found Yes
Hash e3a52b5c79cfe66e34c872738f2e695e1989cc6382daa1c6e99079af39c522c9
SimHash ca57e210c830

Groups

*

Rule Path
Disallow /wp-json/
Disallow /wp-admin/
Disallow /*?
Disallow /?s=*
Disallow /*?post_type*
Disallow /?s=*
Disallow /search/*

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow *.js$
Allow *.css$

googlebot

Rule Path
Allow *.js
Allow *.css

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
shopwiki
showyoubot
sosospider
wocbot
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot

Rule Path
Disallow /