一、requests模块

1.requests模块中text方法的使用

import requests

response = requests.get(url='https://www.baidu.com')
print(response.text) # 使用响应对象的text属性提取响应对象中的网页源代码字符串

在这里插入图片描述

2.requests模块中的json()方法的调用

import requests

url = 'https://movie.douban.com/j/chart/top_list'
headers = {
'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36'
}
params = {
	'type': '25', 
	'interval_id': '100:90', 
	'action': '', 
	'start': '0', 
	'limit': '1'
}
response = requests.get(url, headers = headers, params = params)
print(response.json())

在这里插入图片描述

3.requests模块中的content方法的调用

import requests

url = 'https://i2.hdslb.com/bfs/archive/3dbee6dd124569216ddd692ce5f16925c257e5f1.jpg@672w_378h_1c_100q.webp'
headers = {
'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36'
}
response=requests.get(url,headers = headers)
content = response.content
print(content)
with open('图片.webp', 'wb') as fp:
    fp.write(content)

在这里插入图片描述

二、json模块的应用

1. 示例代码

【json的基本使用】
json.loads() 	# json字符串转化为python数据类型
json.dumps() 	# python数据类型转化为json字符串
json.load()  	# 包含json的类文件对象转化为python数据类型
json.dump() 	# python数据类型转化为包含json的类文件对象

import requests
import json

url = 'https://movie.douban.com/j/chart/top_list'
headers = {
'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36'
}
params = {
'type': '25',
'interval_id':'100:90',
'action': '', 
'start':'0', 
'limit': '1'}

response = requests.get(url = url, params = params, headers = headers)
content = response.json()
for i in content:
    print(json.dumps(i, indent = 4, ensure_ascii = False, separators = (', ', ': ')))
    break
with open('豆瓣电影动画排行榜.txt', 'w', encoding = 'utf-8') as fp:
    for i in content:
        title = i['title'] # 取出键名为title对应的值
        score = i['score'] # 取出键名为score对应的值
        fp.write(title + '  ' + score + '\n')