wget_robots_st Struct Reference

Data Fields
wget_vector *	paths
	paths found in robots.txt (element: wget_string)
wget_vector *	sitemaps
	sitemaps found in robots.txt (element: char *)

---

The documentation for this struct was generated from the following file:

• robots.c