目录
一、数据及分析对象
CSV文件------"bc_data.csv"
数据集链接：https://download.csdn.net/download/m0_70452407/88524905
该数据集主要记录了569个病例的32个属性，主要属性/字段如下：
（1）ID：病例的ID。
（2）Diagnosis（诊断结果）：M为恶性，B为良性。该数据集共包含357个良性病例和212个恶性病例。
（3）细胞核的10个特征值，包括radius（半径）、texture（纹理）、perimeter（周长）、面积（area）、平滑度（smoothness）、紧凑度（compactness）、凹面（concavity）、凹点（concave points）、对称性（symmetry）和分形维数（fractal dimension）等。同时，为上述10个特征值分别提供了3种统计量，分别为均值（mean）、标准差（standard error）和最大值（worst or largest）。
二、目的及分析任务
理解机器学习方法在数据分析中的应用------采用逻辑回归方法进行分类分析。
（1）数据读入。
（2）划分训练集和数据集，利用逻辑回归算法进行模型训练，分类分析。
（3）进行模型评价，调整模型参数。
（4）将调参后的模型进行模型预测，得出的结果与测试集结果进行对比分析，验证逻辑回归算法建模的有效性。
三、方法及工具
Python语言及scikit-learn包。
四、数据读入
导入所需的工具包：
python
import pandas as pd
import numpy as np
from sklearn.linear_model import LogisticRegression
from sklearn import metrics导入scikit-learn自带的数据集------威斯康星州乳腺癌数据集，这里采用的实现方式为调用sklearn.datasets中的load_breast_cancer()方法。
python
#数据读入
from sklearn.datasets import load_breast_cancer
breast_cancer=load_breast_cancer()导入的威斯康星州乳腺癌数据集是字典数据，显示其字典的键为：
python
#显示数据集字典的键
print(breast_cancer.keys())
pythondict_keys(['data', 'target', 'frame', 'target_names', 'DESCR', 'feature_names', 'filename', 'data_module'])
输出结果中，'target'为分类目标，'DESCR'为数据集的完整性描述，'feature_names'为特征名称。
显示数据集的完整描述：
python
print(breast_cancer.DESCR)
python.. _breast_cancer_dataset: Breast cancer wisconsin (diagnostic) dataset -------------------------------------------- **Data Set Characteristics:** :Number of Instances: 569 :Number of Attributes: 30 numeric, predictive attributes and the class :Attribute Information: - radius (mean of distances from center to points on the perimeter) - texture (standard deviation of gray-scale values) - perimeter - area - smoothness (local variation in radius lengths) - compactness (perimeter^2 / area - 1.0) - concavity (severity of concave portions of the contour) - concave points (number of concave portions of the contour) - symmetry - fractal dimension ("coastline approximation" - 1) The mean, standard error, and "worst" or largest (mean of the three worst/largest values) of these features were computed for each image, resulting in 30 features. For instance, field 0 is Mean Radius, field 10 is Radius SE, field 20 is Worst Radius. - class: - WDBC-Malignant - WDBC-Benign :Summary Statistics: ===================================== ====== ====== Min Max ===================================== ====== ====== radius (mean): 6.981 28.11 texture (mean): 9.71 39.28 perimeter (mean): 43.79 188.5 area (mean): 143.5 2501.0 smoothness (mean): 0.053 0.163 compactness (mean): 0.019 0.345 concavity (mean): 0.0 0.427 concave points (mean): 0.0 0.201 symmetry (mean): 0.106 0.304 fractal dimension (mean): 0.05 0.097 radius (standard error): 0.112 2.873 texture (standard error): 0.36 4.885 perimeter (standard error): 0.757 21.98 area (standard error): 6.802 542.2 smoothness (standard error): 0.002 0.031 compactness (standard error): 0.002 0.135 concavity (standard error): 0.0 0.396 concave points (standard error): 0.0 0.053 symmetry (standard error): 0.008 0.079 fractal dimension (standard error): 0.001 0.03 radius (worst): 7.93 36.04 texture (worst): 12.02 49.54 perimeter (worst): 50.41 251.2 area (worst): 185.2 4254.0 smoothness (worst): 0.071 0.223 compactness (worst): 0.027 1.058 concavity (worst): 0.0 1.252 concave points (worst): 0.0 0.291 symmetry (worst): 0.156 0.664 fractal dimension (worst): 0.055 0.208 ===================================== ====== ====== :Missing Attribute Values: None :Class Distribution: 212 - Malignant, 357 - Benign :Creator: Dr. William H. Wolberg, W. Nick Street, Olvi L. Mangasarian :Donor: Nick Street :Date: November, 1995 This is a copy of UCI ML Breast Cancer Wisconsin (Diagnostic) datasets. https://goo.gl/U2Uwz2 Features are computed from a digitized image of a fine needle aspirate (FNA) of a breast mass. They describe characteristics of the cell nuclei present in the image. Separating plane described above was obtained using Multisurface Method-Tree (MSM-T) [K. P. Bennett, "Decision Tree Construction Via Linear Programming." Proceedings of the 4th Midwest Artificial Intelligence and Cognitive Science Society, pp. 97-101, 1992], a classification method which uses linear programming to construct a decision tree. Relevant features were selected using an exhaustive search in the space of 1-4 features and 1-3 separating planes. The actual linear program used to obtain the separating plane in the 3-dimensional space is that described in: [K. P. Bennett and O. L. Mangasarian: "Robust Linear Programming Discrimination of Two Linearly Inseparable Sets", Optimization Methods and Software 1, 1992, 23-34]. This database is also available through the UW CS ftp server: ftp ftp.cs.wisc.edu cd math-prog/cpo-dataset/machine-learn/WDBC/ .. topic:: References - W.N. Street, W.H. Wolberg and O.L. Mangasarian. Nuclear feature extraction for breast tumor diagnosis. IS&T/SPIE 1993 International Symposium on Electronic Imaging: Science and Technology, volume 1905, pages 861-870, San Jose, CA, 1993. - O.L. Mangasarian, W.N. Street and W.H. Wolberg. Breast cancer diagnosis and prognosis via linear programming. Operations Research, 43(4), pages 570-577, July-August 1995. - W.H. Wolberg, W.N. Street, and O.L. Mangasarian. Machine learning techniques to diagnose breast cancer from fine-needle aspirates. Cancer Letters 77 (1994) 163-171.
显示数据集的特征名称：
python
#数据集的特征名称
print(breast_cancer.feature_names)
python['mean radius' 'mean texture' 'mean perimeter' 'mean area' 'mean smoothness' 'mean compactness' 'mean concavity' 'mean concave points' 'mean symmetry' 'mean fractal dimension' 'radius error' 'texture error' 'perimeter error' 'area error' 'smoothness error' 'compactness error' 'concavity error' 'concave points error' 'symmetry error' 'fractal dimension error' 'worst radius' 'worst texture' 'worst perimeter' 'worst area' 'worst smoothness' 'worst compactness' 'worst concavity' 'worst concave points' 'worst symmetry' 'worst fractal dimension']
显示数据形状：
python
#数据形状
print(breast_cancer.data.shape)
python(569, 30)
调用pandas包数据框（DataFrame），将数据（data）与回归目标（target）转化为数据框类型。
python
#将数据（data）与回归目标(target)转换为数据框类型
X=pd.DataFrame(breast_cancer.data,columns=breast_cancer.feature_names)
y=pd.DataFrame(breast_cancer.target,columns=['class'])将X，y数据框合并后，生成数据集df
python
#合并数据框
df=pd.concat([X,y],axis=1)
df
五、数据理解
查看数据基本信息：
python
#查看数据基本信息
df.info()
python<class 'pandas.core.frame.DataFrame'> RangeIndex: 569 entries, 0 to 568 Data columns (total 31 columns): # Column Non-Null Count Dtype --- ------ -------------- ----- 0 mean radius 569 non-null float64 1 mean texture 569 non-null float64 2 mean perimeter 569 non-null float64 3 mean area 569 non-null float64 4 mean smoothness 569 non-null float64 5 mean compactness 569 non-null float64 6 mean concavity 569 non-null float64 7 mean concave points 569 non-null float64 8 mean symmetry 569 non-null float64 9 mean fractal dimension 569 non-null float64 10 radius error 569 non-null float64 11 texture error 569 non-null float64 12 perimeter error 569 non-null float64 13 area error 569 non-null float64 14 smoothness error 569 non-null float64 15 compactness error 569 non-null float64 16 concavity error 569 non-null float64 17 concave points error 569 non-null float64 18 symmetry error 569 non-null float64 19 fractal dimension error 569 non-null float64 20 worst radius 569 non-null float64 21 worst texture 569 non-null float64 22 worst perimeter 569 non-null float64 23 worst area 569 non-null float64 24 worst smoothness 569 non-null float64 25 worst compactness 569 non-null float64 26 worst concavity 569 non-null float64 27 worst concave points 569 non-null float64 28 worst symmetry 569 non-null float64 29 worst fractal dimension 569 non-null float64 30 class 569 non-null int32 dtypes: float64(30), int32(1) memory usage: 135.7 KB
查看描述性统计信息：
python
#查看描述新统计信息
df.describe()六、数据准备
利用sklearn.model_selection的train_test_split()方法划分训练集和测试集，固定random_state为42，用30%的数据测试，70%的数据训练。
python
#划分训练集和测试集
from sklearn.model_selection import train_test_split
X_train,X_test,y_train,y_test=train_test_split(X,y,
test_size=0.3,random_state=42)
X_test
七、模型训练
调用默认参数的LogisticRegression在训练集上进行模型训练。
python
#模型训练
model=LogisticRegression(C=1.0,
class_weight=None,
dual=False,
fit_intercept=True,
intercept_scaling=1,
max_iter=100,
multi_class='ovr',
n_jobs=1,
penalty='l2',
random_state=None,
solver='liblinear',
tol=0.0001,
verbose=0,
warm_start=False)
model.fit(X_train,y_train)
pythonLogisticRegression(multi_class='ovr', n_jobs=1, solver='liblinear')
该输出结果显示了模型的训练结果。选择逻辑回归模型参数的默认值进行训练。选择L2正则项，C=1.0控制正则化的强度。"fit_intercept=True,intercept_scaling=1"表示增加截距缩放，减少正则化对综合特征权重的影响。"class_weight=None"表示所有类都有权重。"solver=liblinear"时（在最优化问题时使用"liblinear"算法）。max_iter=100表示求解器收敛所采用的最大迭代次数为100。multi_class="ovr"表示每个标签都适合一个二进制问题。n_jobs表示在类上并行时使用的CPU核心数量。当warm_start设置为True时，重用前一个调用的解决方案以适应初始化，否则，只需删除前一个解决方案。
显示预测结果：
python
#默认参数模型预测结果y_pred
y_pred=model.predict(X_test)
y_pred
pythonarray([1, 0, 0, 1, 1, 0, 0, 0, 1, 1, 1, 0, 1, 0, 1, 0, 1, 1, 1, 0, 1, 1, 0, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 0, 1, 0, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 1, 1, 1, 1, 1, 0, 1, 1, 1, 0, 0, 1, 1, 1, 0, 0, 1, 1, 0, 0, 1, 0, 1, 1, 1, 1, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 1, 0, 0, 1, 0, 0, 1, 1, 1, 0, 1, 1, 0, 1, 0, 0, 1, 0, 1, 1, 1, 0, 0, 1, 1, 0, 1, 0, 0, 1, 1, 0, 0, 0, 1, 1, 1, 0, 1, 1, 1, 0, 1, 0, 1, 1, 0, 1, 0, 0, 0, 1, 0, 1, 1, 1, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 0, 1])
八、模型评价
利用混淆矩阵分类算法的指标进行模型的分类效果评价。
python
#混淆矩阵（分类算法的重要评估指标）
matrix=metrics.confusion_matrix(y_test,y_pred)
matrix
pythonarray([[ 59, 4], [ 2, 106]], dtype=int64)
利用准确度（Accuracy）、精度（Precision）这两项分类指标进行模型的分类效果评价。
python
#分类评价指标------准确度（Accuracy）
print("Accuracy:",metrics.accuracy_score(y_test,y_pred))
#分类评价指标------精度（Precision）
print("Precision:",metrics.precision_score(y_test,y_pred))
pythonAccuracy: 0.9649122807017544 Precision: 0.9636363636363636
九、模型调参
设置GridSearchCV函数的param_grid、cv参数值。为了防止过拟合现象的出现，通过参数C控制正则化程度，C值越大，正则化越弱。一般情况下，C增大（正则化程度弱），模型的准确性在训练集和测试集上都在提升（对损失函数的惩罚减弱），特征维度更多，学习能力更强，过拟合的风险也更高。L1和L2两项正则化项对目标函数的影响不同，选择的求解模型惨啊书的梯度下降法也不同。
python
#以C、penalty参数和值设置字典列表param_grid。
#设置cv参数值为5
param_grid={'C':[0.001,0.01,0.1,1,10,20,50,100],
'penalty':["l1","l2"]}
n_folds=5调用GridSearchCV函数，进行5折交叉验证，得出模型最优参数：
python
#调用GridSearchCV函数，进行5折交叉验证，对估计器LogisticRegression()的指定参数值param_grid进行详尽搜索，得到最终的最优模型参数
from sklearn.model_selection import GridSearchCV
estimator=GridSearchCV(LogisticRegression(solver='liblinear'),param_grid,cv=n_folds)
estimator.fit(X_train,y_train)
pythonGridSearchCV(cv=5, estimator=LogisticRegression(solver='liblinear'), param_grid={'C': [0.001, 0.01, 0.1, 1, 10, 20, 50, 100], 'penalty': ['l1', 'l2']})
该输出结果显示了调用GridSearchCV()方法对估计器的指定参数值进行详尽搜索。
利用best_estimator_属性，得到通过搜索选择的最高分（或最小损失的估计量）：
python
estimator.best_estimator_
pythonLogisticRegression(C=50, penalty='l1', solver='liblinear')
该输出结果显示了最优的模型参数为C=50，penalty="l1"
十、模型预测
调参后的模型训练：
python
#调参后的模型训练
model1=LogisticRegression(C=50,
class_weight=None,
dual=False,
fit_intercept=True,
intercept_scaling=1,
max_iter=100,
multi_class='ovr',
n_jobs=1,
penalty='l1',
random_state=None,
solver='liblinear',
tol=0.0001,
verbose=0,
warm_start=False)
model1.fit(X_train,y_train)
pythonLogisticRegression(C=50, multi_class='ovr', n_jobs=1, penalty='l1', solver='liblinear')
调参后的模型预测：
python
#调参后的模型预测
y_pred1=model1.predict(X_test)
y_pred1
pythonarray([1, 0, 0, 1, 1, 0, 0, 0, 1, 1, 1, 0, 1, 0, 1, 0, 1, 1, 1, 0, 1, 1, 0, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 0, 1, 0, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 1, 1, 1, 1, 1, 0, 0, 1, 1, 0, 0, 1, 1, 1, 0, 0, 1, 1, 0, 0, 1, 0, 1, 1, 1, 0, 1, 1, 0, 1, 0, 0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 1, 0, 0, 1, 0, 0, 1, 1, 1, 0, 1, 1, 0, 1, 0, 0, 0, 0, 1, 1, 1, 0, 0, 1, 1, 0, 1, 0, 0, 1, 1, 0, 0, 0, 1, 1, 1, 0, 1, 1, 1, 0, 1, 0, 1, 1, 0, 1, 0, 0, 0, 1, 0, 1, 1, 1, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 0, 1])
调参后的模型混淆矩阵结果：
python
#调参后的模型混淆矩阵结果
matrix1=metrics.confusion_matrix(y_test,y_pred1)
matrix1
pythonarray([[ 62, 1], [ 3, 105]], dtype=int64)
调参后的模型准确度、精度分类指标评价结果：
python
#调参后的额模型准确度、精度分类指标评价结果
print("Accuracy1:",metrics.accuracy_score(y_test,y_pred1))
print("Precision1:",metrics.precision_score(y_test,y_pred1))
pythonAccuracy1: 0.9766081871345029 Precision1: 0.9905660377358491
该输出结果显示了调参后的模型分类指标准确度（Accuracy）、精度（Precision）分类指标值。通过与之前未调参的模型分类效果进行对比，可以发现准确度（Accuracy）、精度（Precision）值提升，混淆矩阵得出的结果也更好，分类效果显著提升。