robotstxt / robots.txt

Robots.txt Information

Robot	Path	Permission
GoogleBot	/	✔
BingBot	/	✔
BaiduSpider	/	✔
YandexBot	/	✔
# Allow all bots. # See also http://www.robotstxt.org/ User-agent: *

Meta Tags

Title	robots.txt
Description	SEO Consulting robots.txt History {{ title }} {{ robots_url }} Search Made by Fili ®
Keywords	N/A

Server Information

WebSite	robotstxt.com
Host IP	216.239.36.21
Location	United States

Related Websites

                        Site
                        Rank
                    

More to Explore

robotstxt.com Valuation

US$1,470

Last updated: 2023-05-10 04:28:58

robotstxt.com has Semrush global rank of 0. robotstxt.com has an estimated worth of US$ 1,470, based on its estimated Ads revenue. robotstxt.com receives approximately 169 unique visitors each day. Its web server is located in United States, with IP address 216.239.36.21. According to SiteAdvisor, robotstxt.com is safe to visit.

Traffic & Worth Estimates

Purchase/Sale Value	US$1,470
Daily Ads Revenue	US$1
Monthly Ads Revenue	US$40
Yearly Ads Revenue	US$488
Daily Unique Visitors	11
Note: All traffic and earnings values are estimates.

DNS Records

Host	Type	TTL	Data
robotstxt.com.	A	7199	IP: 216.239.36.21
robotstxt.com.	A	7199	IP: 216.239.38.21
robotstxt.com.	A	7199	IP: 216.239.34.21
robotstxt.com.	A	7199	IP: 216.239.32.21
robotstxt.com.	AAAA	7199	IPV6: 2001:4860:4802:38::15
robotstxt.com.	AAAA	7199	IPV6: 2001:4860:4802:32::15
robotstxt.com.	AAAA	7199	IPV6: 2001:4860:4802:34::15
robotstxt.com.	AAAA	7199	IPV6: 2001:4860:4802:36::15
robotstxt.com.	NS	3600	NS Record: ns3.openprovider.eu.
robotstxt.com.	NS	3600	NS Record: ns2.openprovider.be.
robotstxt.com.	NS	3600	NS Record: ns1.openprovider.nl.
robotstxt.com.	MX	86400	MX Record: 5 ALT1.ASPMX.L.GOOGLE.com.
robotstxt.com.	MX	86400	MX Record: 1 ASPMX.L.GOOGLE.com.
robotstxt.com.	MX	86400	MX Record: 10 ASPMX3.GOOGLEMAIL.com.
robotstxt.com.	MX	86400	MX Record: 5 ALT2.ASPMX.L.GOOGLE.com.
robotstxt.com.	MX	86400	MX Record: 10 ASPMX2.GOOGLEMAIL.com.
robotstxt.com.	TXT	86400	TXT Record: google-site-verification=VleMzjPHTMl5hOV3zaAXi5Bkipv5-tbSUoNfCi7Te4k
robotstxt.com.	TXT	86400	TXT Record: v=spf1 include:u2184761.wl012.sendgrid.net include:_spf.google.com ~all

HtmlToTextCheckTime:2023-05-10 04:28:58

SEO Consulting robots.txt History {{ title }} {{ robots_url }} Search Made by Fili ®

HTTP Headers

HTTP/1.1 301 Moved Permanently
Location: https://robotstxt.com/
X-Cloud-Trace-Context: b65c6fcc95ed88e7acdfa411ef9833ce
Date: Tue, 02 Nov 2021 03:38:40 GMT
Content-Type: text/html
Server: Google Frontend
Transfer-Encoding: chunked

HTTP/2 200 
content-type: text/html; charset=utf-8
vary: Accept-Encoding
vary: Accept-Encoding
strict-transport-security: max-age=63072000; includeSubDomains; preload
pragma: public
cache-control: public, max-age=86400
x-content-type-options: nosniff
x-frame-options: SAMEORIGIN
x-ua-compatible: IE=Edge,chrome=1
x-xss-protection: 1; mode=block
x-versionid: 20190906t104250
x-cloud-trace-context: 4104656fb98a9bf4e7f12e10e20b5ea5
content-length: 3455
date: Tue, 02 Nov 2021 03:38:40 GMT
server: Google Frontend

robotstxt.com Whois Information

Domain Name: ROBOTSTXT.COM
Registry Domain ID: 28699061_DOMAIN_COM-VRSN
Registrar WHOIS Server: whois.registrar.eu
Registrar URL: http://www.openprovider.com
Updated Date: 2021-07-20T17:22:07Z
Creation Date: 2000-06-06T20:49:11Z
Registry Expiry Date: 2031-06-06T20:49:11Z
Registrar: Hosting Concepts B.V. d/b/a Registrar.eu
Registrar IANA ID: 1647
Registrar Abuse Contact Email: abuse@registrar.eu
Registrar Abuse Contact Phone: +31.104482297
Domain Status: clientTransferProhibited https://icann.org/epp#clientTransferProhibited
Name Server: NS1.OPENPROVIDER.NL
Name Server: NS2.OPENPROVIDER.BE
Name Server: NS3.OPENPROVIDER.EU
DNSSEC: signedDelegation
DNSSEC DS Data: 39829 8 2 856B978C97F3D7E56194F8AF533BBEEF584A62C80F3D40B144346D96800AF660
>>> Last update of whois database: 2021-09-20T12:11:30Z <<<

robotstxt.com valuation and analysis