爬虫大佬的网站：https://github.com/01ly
hashlib.md5
重定向：
import requests
res = requests.get(url="", headers={}, allow_redirects=False) # 禁止重定向
next_url = res.headers['Location'] # 找到打算重定向的url
============= 自定义 window document
var window = global;
window.location = {
host: "www.toutiao.com",
hostname: "www.toutiao.com",
href: "https://www.toutiao.com/",
origin: "https://www.toutiao.com",
pathname: "",
port: "",
protocol: "https:",
};
window.navigator = {
userAgent:'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.97 Safari/537.36'
};
=========== execjs
=========== post请求提交数据
==========js中获取参数
============调用js
