WmZilla - Webmaster and Marketplace

The Next Generation Webmaster and Trade Forum

What should the robot.txt and site map look like?

Capz

New member

0

0%

Status

Offline

Posts

36

Likes

0

Rep

0

Bits

190

3

Months of Service

0%
Hello friends, I have a website that is an SMM site and I have uploaded the site map and robots.txt file. However, I wanted to ask you if the contents are correct. What do you think should be the ideal format for these two file types for a site like mine? I want the blog posts on my site to be indexed as well. Here are the contents of my files:

**Robots.txt File:**
```
User-agent: *
Disallow: /cgi-bin/
```

**Site Map:**
- URL: https://takipcialsana.com/
- Last Modified: 2023-02-20T11:01:19+00:00
- Priority: 1.00

- URL: https://takipcialsana.com/services
- Last Modified: 2023-02-20T11:01:19+00:00
- Priority: 0.80

- URL: https://takipcialsana.com/register
- Last Modified: 2023-02-20T11:01:19+00:00
- Priority: 0.80

- URL: https://takipcialsana.com/forgot
- Last Modified: 2023-02-20T11:01:19+00:00
- Priority: 0.80

- URL: https://takipcialsana.com/terms
- Last Modified: 2023-02-20T11:01:19+00:00
- Priority: 0.80

- URL: https://takipcialsana.com/contact
- Last Modified: 2023-02-20T11:01:19+00:00
- Priority: 0.80

- URL: https://takipcialsana.com/api
- Last Modified: 2023-02-20T11:01:19+00:00
- Priority: 0.80

- URL: https://takipcialsana.com/blog
- Last Modified: 2023-02-20T11:01:19+00:00
- Priority: 0.80

Thank you.
 

249

6,622

6,642

Top