mdl_robots_cache_entry_t Struct Reference

One host's cached robots.txt outcome. More...

#include <mdl_robots.h>

Collaboration diagram for mdl_robots_cache_entry_t:

Data Fields
char	scheme [6]
	Lower-case http or https.
char	host [k_mdl_robots_host_max]
	Host this entry describes.
bool	used
	Entry is populated.
bool	disallow_all
	5xx convention: refuse all.
mdl_robots_t	rules
	Parsed rules for our UA.

Detailed Description

One host's cached robots.txt outcome.

Populated on first contact with an origin (scheme + host) and reused thereafter.

Invariant

used is true once scheme, host, and the outcome are valid.

See also

mdl_robots_cache_consult()

Since

0.1.0

Definition at line 167 of file mdl_robots.h.

Field Documentation

disallow_all

bool mdl_robots_cache_entry_t::disallow_all

5xx convention: refuse all.

Definition at line 171 of file mdl_robots.h.

Referenced by mdl_robots_cache_consult().

host

char mdl_robots_cache_entry_t::host[k_mdl_robots_host_max]

Host this entry describes.

Definition at line 169 of file mdl_robots.h.

Referenced by internal_cache_find(), and mdl_robots_cache_consult().

rules

mdl_robots_t mdl_robots_cache_entry_t::rules

Parsed rules for our UA.

Definition at line 172 of file mdl_robots.h.

Referenced by mdl_robots_cache_consult().

scheme

char mdl_robots_cache_entry_t::scheme[6]

Lower-case http or https.

Definition at line 168 of file mdl_robots.h.

Referenced by internal_cache_find(), and mdl_robots_cache_consult().

used

bool mdl_robots_cache_entry_t::used

Entry is populated.

Definition at line 170 of file mdl_robots.h.

Referenced by internal_cache_find(), internal_cache_slot(), and mdl_robots_cache_consult().

---

The documentation for this struct was generated from the following file:

• apps/shared_libs/mdl/inc/mdl_robots.h