Http Headers - Requests - Python

I am trying to scrape a website in which the request headers are having some new (for me) attributes such as :authority, :method, :path, :scheme. {':authority':'xxxx',':method':'GE

Solution 1:

Your error comes from here (python's source code)

Http headers cannot start with a semicolon as RFC states.

Solution 2:

:authority, :method, :path, :scheme are not http headers

https://en.wikipedia.org/wiki/List_of_HTTP_header_fields

':method':'GET'

defines http request method

https://en.wikipedia.org/wiki/Hypertext_Transfer_Protocol#Request_methods

and

:authority, :path, :scheme

are parts of URI https://en.wikipedia.org/wiki/Uniform_Resource_Identifier#Generic_syntax