WmZilla - Webmaster and Marketplace

The Next Generation Webmaster and Trade Forum

How should the robot.txt and site map be structured?

Capz

New member

0

0%

Status

Offline

Posts

36

Likes

0

Rep

0

Bits

190

5

Months of Service

0%
Hello friends, I have a website, an SMM site. I have uploaded a sitemap and a robots.txt file, but I wanted to ask you if the content is correct. In your opinion, what should be the ideal format for these two types of files for a site like this? I want the blog posts on my site to be indexed as well. Here is the content of my files:

**Robots.txt file content:**
```
# robots.txt
User-agent: *
Disallow:
Disallow: /cgi-bin/
```

**Sitemap content:**
```
Site Map
https://takipcialsana.com/ 2023-02-20T11:01:19+00:00 1.00
https://takipcialsana.com/services 2023-02-20T11:01:19+00:00 0.80
https://takipcialsana.com/register 2023-02-20T11:01:19+00:00 0.80
https://takipcialsana.com/forgot 2023-02-20T11:01:19+00:00 0.80
https://takipcialsana.com/terms 2023-02-20T11:01:19+00:00 0.80
https://takipcialsana.com/contact 2023-02-20T11:01:19+00:00 0.80
https://takipcialsana.com/api 2023-02-20T11:01:19+00:00 0.80
https://takipcialsana.com/blog 2023-02-20T11:01:19+00:00 0.80
```

Thank you.
 

249

6,622

6,642

Top