4장_실습_산탄데르

In [1]:

from IPython.core.display import display, HTML
display(HTML("<style>.container { width:1200px !important; }</style>"))

캐글의 산탄데르 고객 만족 데이터 세트에 대해서 고객 만족 여부를 XHBoost와 LightGBM 을 활용해 예측.

370개의 피처로 주어진 데이터 세트 기반에서 고객 만족 여부를 예측
클래스 레이블 명은 TARGET , 값은 1=불만 0=만족
모델 성능 평가는 ROC-AUC 으로 평가

In [4]:

# 코랩-구글드라이브 연결

from google.colab import drive

drive.mount('/content/gdrive/')

Mounted at /content/gdrive/

In [5]:

import pandas as pd
import numpy as np
import matplotlib.pyplot as plt
%matplotlib inline

# features.txt 파일에는 피처 이름 index와 피처명이 공백으로 분리. DataFrame으로 로드
cust_df = pd.read_csv('/content/gdrive/My Drive/project/data/santander/train/train.csv',encoding='latin-1')
cust_df.head(3)

Out[5]:

	ID	var3	var15	ind_var5_0	ind_var5	ind_var13_0	ind_var13_corto_0	ind_var13_corto	ind_var13	...	saldo_medio_var5_ult1	saldo_medio_var5_ult3	saldo_medio_var13_corto_hace2	saldo_medio_var13_corto_hace3	saldo_medio_var13_corto_ult1	saldo_medio_var13_corto_ult3	var38
0	1	2	23	1	0	0	0	0	0	...	0.0	0.00	0.0	0.00	0.0	0.00	39205.17
1	3	2	34	1	0	1	1	1	1	...	0.0	0.00	300.0	122.22	300.0	240.75	49278.03
2	4	2	23	1	1	0	0	0	0	...	3.0	2.07	0.0	0.00	0.0	0.00	67333.77

3 rows × 371 columns

In [6]:

print('dataset shape : ', cust_df.shape)

dataset shape :  (76020, 371)

In [9]:

# 피처 타입과 null값을 알아보기
cust_df.info()

<class 'pandas.core.frame.DataFrame'>
RangeIndex: 76020 entries, 0 to 76019
Columns: 371 entries, ID to TARGET
dtypes: float64(111), int64(260)
memory usage: 215.2 MB

In [8]:

# 모든 피처가 숫자형이며, null값은 없다.
# 전체 대이터에서 만족과 불만족의 비율을 확인> Target 속성의 값의 분포를 확인

print(cust_df['TARGET'].value_counts())
unsatisfied_cnt = cust_df[cust_df['TARGET'] == 1].TARGET.count()
total_cnt = cust_df.TARGET.count()
print('unsatisfied 비율은 {0:.2f}'.format((unsatisfied_cnt / total_cnt)))

0    73012
1     3008
Name: TARGET, dtype: int64
unsatisfied 비율은 0.04

In [10]:

# 각 피처의 값 분포 확인
cust_df.describe( )

Out[10]:

	ID	var3	var15	imp_ent_var16_ult1	imp_op_var39_comer_ult1	imp_op_var39_comer_ult3	imp_op_var40_comer_ult1	imp_op_var40_comer_ult3	imp_op_var40_efect_ult1	imp_op_var40_efect_ult3	imp_op_var40_ult1	imp_op_var41_comer_ult1	imp_op_var41_comer_ult3	imp_op_var41_efect_ult1	imp_op_var41_efect_ult3	imp_op_var41_ult1	imp_op_var39_efect_ult1	imp_op_var39_efect_ult3	imp_op_var39_ult1	imp_sal_var16_ult1	ind_var1_0	ind_var1	ind_var2_0	ind_var2	ind_var5_0	ind_var5	ind_var6_0	ind_var6	ind_var8_0	ind_var8	ind_var12_0	ind_var12	ind_var13_0	ind_var13_corto_0	ind_var13_corto	ind_var13_largo_0	ind_var13_largo	ind_var13_medio_0	ind_var13_medio	ind_var13	...	saldo_medio_var5_ult1	saldo_medio_var5_ult3	saldo_medio_var8_hace2	saldo_medio_var8_hace3	saldo_medio_var8_ult1	saldo_medio_var8_ult3	saldo_medio_var12_hace2	saldo_medio_var12_hace3	saldo_medio_var12_ult1	saldo_medio_var12_ult3	saldo_medio_var13_corto_hace2	saldo_medio_var13_corto_hace3	saldo_medio_var13_corto_ult1	saldo_medio_var13_corto_ult3	saldo_medio_var13_largo_hace2	saldo_medio_var13_largo_hace3	saldo_medio_var13_largo_ult1	saldo_medio_var13_largo_ult3	saldo_medio_var13_medio_hace2	saldo_medio_var13_medio_hace3	saldo_medio_var13_medio_ult1	saldo_medio_var13_medio_ult3	saldo_medio_var17_hace2	saldo_medio_var17_hace3	saldo_medio_var17_ult1	saldo_medio_var17_ult3	saldo_medio_var29_hace2	saldo_medio_var29_hace3	saldo_medio_var29_ult1	saldo_medio_var29_ult3	saldo_medio_var33_hace2	saldo_medio_var33_hace3	saldo_medio_var33_ult1	saldo_medio_var33_ult3	saldo_medio_var44_hace2	saldo_medio_var44_hace3	saldo_medio_var44_ult1	saldo_medio_var44_ult3	var38	TARGET
count	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.0	76020.0	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	...	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	7.602000e+04	76020.000000	7.602000e+04	7.602000e+04	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	7.602000e+04	7.602000e+04	76020.000000	76020.0	76020.000000	76020.000000	7.602000e+04	7.602000e+04	7.602000e+04	7.602000e+04	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	76020.000000	7.602000e+04	76020.000000
mean	75964.050723	-1523.199277	33.212865	86.208265	72.363067	119.529632	3.559130	6.472698	0.412946	0.567352	3.160715	68.803937	113.056934	68.205140	113.225058	137.242763	68.618087	113.792410	140.403479	5.477676	0.011458	0.003762	0.0	0.0	0.958024	0.663760	0.000105	0.000026	0.032833	0.028598	0.067522	0.045462	0.052249	0.042936	0.041476	0.010168	0.009997	0.000026	0.000026	0.050855	...	1077.256756	1048.856447	68.275452	9.505287	124.620962	110.026575	3.997023e+03	613.534443	5.703008e+03	4.401002e+03	3639.419939	556.184178	4852.261814	3857.848542	771.227449	162.170439	9.569502e+02	7.509563e+02	0.175324	0.0	0.513023	0.344174	9.117181e+01	3.646318e+01	1.310316e+02	1.092169e+02	0.213071	0.001910	0.253907	0.186630	7.935824	1.365146	12.215580	8.784074	31.505324	1.858575	76.026165	56.614351	1.172358e+05	0.039569
std	43781.947379	39033.462364	12.956486	1614.757313	339.315831	546.266294	93.155749	153.737066	30.604864	36.513513	95.268204	319.605516	512.154823	531.897917	950.086398	697.712596	535.473750	953.578624	712.767240	465.391149	0.106425	0.061221	0.0	0.0	0.200535	0.472425	0.010258	0.005129	0.178202	0.166674	0.250925	0.208316	0.222531	0.202714	0.199390	0.100325	0.099486	0.005129	0.005129	0.219703	...	9614.906985	8189.948852	1733.838226	519.389157	2205.249804	1935.305713	3.777314e+04	9292.752726	4.620254e+04	3.550718e+04	26359.174223	7182.642532	31886.615189	25572.245055	13082.155867	4698.868075	1.600698e+04	1.242252e+04	34.625518	0.0	113.597559	73.376513	1.539248e+04	8.612395e+03	1.495653e+04	1.308216e+04	41.820444	0.526626	52.078775	31.879418	455.887218	113.959637	783.207399	538.439211	2013.125393	147.786584	4040.337842	2852.579397	1.826646e+05	0.194945
min	1.000000	-999999.000000	5.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.0	0.0	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	...	-922.380000	-476.070000	-287.670000	0.000000	-3401.340000	-1844.520000	0.000000e+00	0.000000	0.000000e+00	0.000000e+00	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000e+00	0.000000e+00	0.000000	0.0	0.000000	0.000000	-3.000000e-02	0.000000e+00	0.000000e+00	0.000000e+00	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	5.163750e+03	0.000000
25%	38104.750000	2.000000	23.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.0	0.0	1.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	...	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000e+00	0.000000	0.000000e+00	0.000000e+00	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000e+00	0.000000e+00	0.000000	0.0	0.000000	0.000000	0.000000e+00	0.000000e+00	0.000000e+00	0.000000e+00	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	6.787061e+04	0.000000
50%	76043.000000	2.000000	28.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.0	0.0	1.000000	1.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	...	3.000000	2.730000	0.000000	0.000000	0.000000	0.000000	0.000000e+00	0.000000	0.000000e+00	0.000000e+00	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000e+00	0.000000e+00	0.000000	0.0	0.000000	0.000000	0.000000e+00	0.000000e+00	0.000000e+00	0.000000e+00	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	1.064092e+05	0.000000
75%	113748.750000	2.000000	40.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.0	0.0	1.000000	1.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	...	90.000000	83.790000	0.000000	0.000000	0.000000	0.000000	0.000000e+00	0.000000	0.000000e+00	0.000000e+00	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000e+00	0.000000e+00	0.000000	0.0	0.000000	0.000000	0.000000e+00	0.000000e+00	0.000000e+00	0.000000e+00	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	0.000000	1.187563e+05	0.000000
max	151838.000000	238.000000	105.000000	210000.000000	12888.030000	21024.810000	8237.820000	11073.570000	6600.000000	6600.000000	8237.820000	12888.030000	16566.810000	45990.000000	131100.000000	47598.090000	45990.000000	131100.000000	47598.090000	105000.000000	1.000000	1.000000	0.0	0.0	1.000000	1.000000	1.000000	1.000000	1.000000	1.000000	1.000000	1.000000	1.000000	1.000000	1.000000	1.000000	1.000000	1.000000	1.000000	1.000000	...	601428.600000	544365.570000	231351.990000	77586.210000	228031.800000	177582.000000	3.000538e+06	668335.320000	3.004186e+06	2.272859e+06	450000.000000	304838.700000	450000.000000	450000.000000	840000.000000	534000.000000	1.500000e+06	1.034483e+06	7741.950000	0.0	30000.000000	18870.990000	4.210084e+06	2.368559e+06	3.998687e+06	3.525777e+06	10430.010000	145.200000	13793.670000	7331.340000	50003.880000	20385.720000	138831.630000	91778.730000	438329.220000	24650.010000	681462.900000	397884.300000	2.203474e+07	1.000000

8 rows × 371 columns

In [ ]:

# var3 칼럼의 경우 min값이 -999999.000000 인 것을 보아 nan 이나 특정 예외 값을 -999999로 변환 했을 가능성
print(cust_df.var3.value_counts()[:10])

In [11]:

# 1. var3 은 값들이 숫자형이고 -999999는 다른 값들과 편차가 심하기 때문에 값이 가장 많이 나온 2 로 변환.
cust_df['var3'].replace(-999999,2, inplace=True)
# 2. ID 피처는 다순 식별자로 드롭
cust_df.drop('ID',axis=1 , inplace=True)

In [12]:

# 3. 클래스 데이터 세트와 피처 데이터 세트로 분리해 별도의 데이터 세트로 저장
X_features = cust_df.iloc[:, :-1]
y_labels = cust_df.iloc[:, -1]
print('피처 데이터 shape:{0}'.format(X_features.shape))

피처 데이터 shape:(76020, 369)

In [13]:

"""
학습과 성능 평가를 위해서 원본 데이터 세트에서 학습 데이터 세트와 테스트 데이터 세트를 분리.
불만족과 만족 비대칭한 데이터 세트
> 클래스인 Target 값 분포도가 학습 데이터와 테스트 데이터 세트에 모두 비슷하게 추출되었는지 확인
"""


from sklearn.model_selection import train_test_split

X_train, X_test, y_train, y_test = train_test_split(X_features, y_labels,
                                                    test_size=0.2, random_state=0)
train_cnt = y_train.count()
test_cnt = y_test.count()
print('학습 세트 Shape:{0}, 테스트 세트 Shape:{1}'.format(X_train.shape , X_test.shape))

print(' 학습 세트 레이블 값 분포 비율')
print(y_train.value_counts()/train_cnt)
print('\n 테스트 세트 레이블 값 분포 비율')
print(y_test.value_counts()/test_cnt)

학습 세트 Shape:(60816, 369), 테스트 세트 Shape:(15204, 369)
 학습 세트 레이블 값 분포 비율
0    0.960964
1    0.039036
Name: TARGET, dtype: float64

 테스트 세트 레이블 값 분포 비율
0    0.9583
1    0.0417
Name: TARGET, dtype: float64

In [14]:

"""
XGBoost 모델 학습과 하이퍼 파라미터 튜닝
n_estimators = 500
early_stopping_rounds = 100
eval_metric(성능 평가 기준) = ROC-AUC
평가 데이터 세트 = 위에서 분리한 테스트 데이터 세트
eval_set = [(X_train, y_train), (X_test, y_test)]
"""

from xgboost import XGBClassifier
from sklearn.metrics import roc_auc_score

xgb_clf = XGBClassifier(n_estimators=500, random_state=156)

# 학습 수행(조기 중단 파라미터=100)
xgb_clf.fit(X_train, y_train, early_stopping_rounds=100, eval_metric="auc", eval_set=[(X_train, y_train), (X_test, y_test)])

xgb_roc_score = roc_auc_score(y_test, xgb_clf.predict_proba(X_test)[:, 1], average='macro')
print('ROC_AUC : {0:.4f}'.format(xgb_roc_score))

[0]	validation_0-auc:0.799928	validation_1-auc:0.803548
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 100 rounds.
[1]	validation_0-auc:0.802222	validation_1-auc:0.805222
[2]	validation_0-auc:0.80819	validation_1-auc:0.813162
[3]	validation_0-auc:0.8127	validation_1-auc:0.813243
[4]	validation_0-auc:0.81648	validation_1-auc:0.816979
[5]	validation_0-auc:0.816018	validation_1-auc:0.816629
[6]	validation_0-auc:0.816474	validation_1-auc:0.817776
[7]	validation_0-auc:0.818148	validation_1-auc:0.818464
[8]	validation_0-auc:0.81806	validation_1-auc:0.818295
[9]	validation_0-auc:0.817039	validation_1-auc:0.818087
[10]	validation_0-auc:0.818318	validation_1-auc:0.818749
[11]	validation_0-auc:0.818711	validation_1-auc:0.818521
[12]	validation_0-auc:0.818673	validation_1-auc:0.818516
[13]	validation_0-auc:0.819156	validation_1-auc:0.818998
[14]	validation_0-auc:0.819847	validation_1-auc:0.81999
[15]	validation_0-auc:0.822152	validation_1-auc:0.821584
[16]	validation_0-auc:0.822529	validation_1-auc:0.821275
[17]	validation_0-auc:0.822404	validation_1-auc:0.821602
[18]	validation_0-auc:0.825227	validation_1-auc:0.82523
[19]	validation_0-auc:0.82554	validation_1-auc:0.824671
[20]	validation_0-auc:0.826569	validation_1-auc:0.825722
[21]	validation_0-auc:0.827255	validation_1-auc:0.825777
[22]	validation_0-auc:0.82805	validation_1-auc:0.826496
[23]	validation_0-auc:0.827807	validation_1-auc:0.826436
[24]	validation_0-auc:0.828647	validation_1-auc:0.826735
[25]	validation_0-auc:0.830001	validation_1-auc:0.827854
[26]	validation_0-auc:0.83056	validation_1-auc:0.828164
[27]	validation_0-auc:0.830946	validation_1-auc:0.828579
[28]	validation_0-auc:0.831843	validation_1-auc:0.829661
[29]	validation_0-auc:0.833095	validation_1-auc:0.830722
[30]	validation_0-auc:0.833537	validation_1-auc:0.83108
[31]	validation_0-auc:0.834132	validation_1-auc:0.830665
[32]	validation_0-auc:0.83448	validation_1-auc:0.831507
[33]	validation_0-auc:0.83477	validation_1-auc:0.831309
[34]	validation_0-auc:0.835454	validation_1-auc:0.831417
[35]	validation_0-auc:0.83601	validation_1-auc:0.831663
[36]	validation_0-auc:0.836456	validation_1-auc:0.831942
[37]	validation_0-auc:0.836577	validation_1-auc:0.832411
[38]	validation_0-auc:0.836988	validation_1-auc:0.832691
[39]	validation_0-auc:0.837236	validation_1-auc:0.833003
[40]	validation_0-auc:0.837868	validation_1-auc:0.83271
[41]	validation_0-auc:0.838638	validation_1-auc:0.833271
[42]	validation_0-auc:0.839178	validation_1-auc:0.83321
[43]	validation_0-auc:0.839711	validation_1-auc:0.833446
[44]	validation_0-auc:0.840394	validation_1-auc:0.834412
[45]	validation_0-auc:0.841118	validation_1-auc:0.834399
[46]	validation_0-auc:0.841513	validation_1-auc:0.834504
[47]	validation_0-auc:0.842197	validation_1-auc:0.835669
[48]	validation_0-auc:0.842644	validation_1-auc:0.835846
[49]	validation_0-auc:0.843012	validation_1-auc:0.835977
[50]	validation_0-auc:0.843695	validation_1-auc:0.836633
[51]	validation_0-auc:0.84425	validation_1-auc:0.83715
[52]	validation_0-auc:0.844535	validation_1-auc:0.837182
[53]	validation_0-auc:0.84508	validation_1-auc:0.837583
[54]	validation_0-auc:0.845616	validation_1-auc:0.838102
[55]	validation_0-auc:0.84602	validation_1-auc:0.837964
[56]	validation_0-auc:0.846645	validation_1-auc:0.838467
[57]	validation_0-auc:0.846941	validation_1-auc:0.838353
[58]	validation_0-auc:0.847311	validation_1-auc:0.838367
[59]	validation_0-auc:0.847784	validation_1-auc:0.838421
[60]	validation_0-auc:0.848181	validation_1-auc:0.838609
[61]	validation_0-auc:0.848445	validation_1-auc:0.838766
[62]	validation_0-auc:0.848953	validation_1-auc:0.838939
[63]	validation_0-auc:0.849405	validation_1-auc:0.839378
[64]	validation_0-auc:0.849601	validation_1-auc:0.839421
[65]	validation_0-auc:0.849941	validation_1-auc:0.839629
[66]	validation_0-auc:0.850161	validation_1-auc:0.839715
[67]	validation_0-auc:0.850322	validation_1-auc:0.839662
[68]	validation_0-auc:0.850512	validation_1-auc:0.839569
[69]	validation_0-auc:0.850868	validation_1-auc:0.839678
[70]	validation_0-auc:0.850981	validation_1-auc:0.839758
[71]	validation_0-auc:0.851145	validation_1-auc:0.839931
[72]	validation_0-auc:0.851305	validation_1-auc:0.839947
[73]	validation_0-auc:0.851522	validation_1-auc:0.84007
[74]	validation_0-auc:0.851667	validation_1-auc:0.840082
[75]	validation_0-auc:0.851955	validation_1-auc:0.840037
[76]	validation_0-auc:0.852125	validation_1-auc:0.840091
[77]	validation_0-auc:0.852316	validation_1-auc:0.839871
[78]	validation_0-auc:0.852587	validation_1-auc:0.840114
[79]	validation_0-auc:0.852811	validation_1-auc:0.840282
[80]	validation_0-auc:0.853092	validation_1-auc:0.840574
[81]	validation_0-auc:0.853296	validation_1-auc:0.84075
[82]	validation_0-auc:0.853443	validation_1-auc:0.840738
[83]	validation_0-auc:0.8536	validation_1-auc:0.840735
[84]	validation_0-auc:0.853727	validation_1-auc:0.840904
[85]	validation_0-auc:0.853878	validation_1-auc:0.840985
[86]	validation_0-auc:0.853998	validation_1-auc:0.841019
[87]	validation_0-auc:0.854281	validation_1-auc:0.840802
[88]	validation_0-auc:0.85445	validation_1-auc:0.841042
[89]	validation_0-auc:0.854524	validation_1-auc:0.841086
[90]	validation_0-auc:0.854656	validation_1-auc:0.841144
[91]	validation_0-auc:0.854908	validation_1-auc:0.841263
[92]	validation_0-auc:0.855061	validation_1-auc:0.841208
[93]	validation_0-auc:0.855142	validation_1-auc:0.841265
[94]	validation_0-auc:0.855326	validation_1-auc:0.84131
[95]	validation_0-auc:0.855442	validation_1-auc:0.841254
[96]	validation_0-auc:0.855568	validation_1-auc:0.841282
[97]	validation_0-auc:0.855671	validation_1-auc:0.841346
[98]	validation_0-auc:0.855955	validation_1-auc:0.841386
[99]	validation_0-auc:0.856271	validation_1-auc:0.841459
[100]	validation_0-auc:0.856386	validation_1-auc:0.841469
[101]	validation_0-auc:0.856627	validation_1-auc:0.841492
[102]	validation_0-auc:0.856774	validation_1-auc:0.841468
[103]	validation_0-auc:0.856898	validation_1-auc:0.841253
[104]	validation_0-auc:0.857145	validation_1-auc:0.841343
[105]	validation_0-auc:0.857279	validation_1-auc:0.841249
[106]	validation_0-auc:0.857362	validation_1-auc:0.841119
[107]	validation_0-auc:0.857423	validation_1-auc:0.841105
[108]	validation_0-auc:0.857487	validation_1-auc:0.841122
[109]	validation_0-auc:0.857658	validation_1-auc:0.841165
[110]	validation_0-auc:0.857734	validation_1-auc:0.8412
[111]	validation_0-auc:0.85792	validation_1-auc:0.841214
[112]	validation_0-auc:0.858102	validation_1-auc:0.841162
[113]	validation_0-auc:0.858246	validation_1-auc:0.841156
[114]	validation_0-auc:0.858382	validation_1-auc:0.841204
[115]	validation_0-auc:0.85846	validation_1-auc:0.841295
[116]	validation_0-auc:0.858562	validation_1-auc:0.841256
[117]	validation_0-auc:0.858616	validation_1-auc:0.84133
[118]	validation_0-auc:0.858718	validation_1-auc:0.841398
[119]	validation_0-auc:0.858829	validation_1-auc:0.841496
[120]	validation_0-auc:0.859012	validation_1-auc:0.841352
[121]	validation_0-auc:0.859142	validation_1-auc:0.841349
[122]	validation_0-auc:0.859203	validation_1-auc:0.841364
[123]	validation_0-auc:0.859284	validation_1-auc:0.84141
[124]	validation_0-auc:0.859563	validation_1-auc:0.841393
[125]	validation_0-auc:0.859639	validation_1-auc:0.84149
[126]	validation_0-auc:0.859759	validation_1-auc:0.841484
[127]	validation_0-auc:0.859957	validation_1-auc:0.841333
[128]	validation_0-auc:0.860087	validation_1-auc:0.841352
[129]	validation_0-auc:0.860211	validation_1-auc:0.841287
[130]	validation_0-auc:0.860261	validation_1-auc:0.841392
[131]	validation_0-auc:0.860444	validation_1-auc:0.841481
[132]	validation_0-auc:0.860453	validation_1-auc:0.841462
[133]	validation_0-auc:0.860607	validation_1-auc:0.841342
[134]	validation_0-auc:0.860749	validation_1-auc:0.84124
[135]	validation_0-auc:0.86094	validation_1-auc:0.841318
[136]	validation_0-auc:0.861021	validation_1-auc:0.841351
[137]	validation_0-auc:0.861131	validation_1-auc:0.841311
[138]	validation_0-auc:0.861229	validation_1-auc:0.841289
[139]	validation_0-auc:0.861279	validation_1-auc:0.841295
[140]	validation_0-auc:0.861331	validation_1-auc:0.841265
[141]	validation_0-auc:0.861418	validation_1-auc:0.841259
[142]	validation_0-auc:0.861553	validation_1-auc:0.841335
[143]	validation_0-auc:0.861682	validation_1-auc:0.841346
[144]	validation_0-auc:0.86169	validation_1-auc:0.841403
[145]	validation_0-auc:0.861852	validation_1-auc:0.841299
[146]	validation_0-auc:0.861898	validation_1-auc:0.841301
[147]	validation_0-auc:0.861998	validation_1-auc:0.841289
[148]	validation_0-auc:0.862068	validation_1-auc:0.84135
[149]	validation_0-auc:0.862132	validation_1-auc:0.841444
[150]	validation_0-auc:0.862236	validation_1-auc:0.841409
[151]	validation_0-auc:0.862314	validation_1-auc:0.841459
[152]	validation_0-auc:0.862584	validation_1-auc:0.841456
[153]	validation_0-auc:0.862843	validation_1-auc:0.841483
[154]	validation_0-auc:0.863033	validation_1-auc:0.841493
[155]	validation_0-auc:0.863132	validation_1-auc:0.841534
[156]	validation_0-auc:0.863423	validation_1-auc:0.841728
[157]	validation_0-auc:0.863578	validation_1-auc:0.841712
[158]	validation_0-auc:0.863872	validation_1-auc:0.841677
[159]	validation_0-auc:0.863924	validation_1-auc:0.841658
[160]	validation_0-auc:0.863985	validation_1-auc:0.841608
[161]	validation_0-auc:0.864019	validation_1-auc:0.841646
[162]	validation_0-auc:0.864049	validation_1-auc:0.841665
[163]	validation_0-auc:0.864148	validation_1-auc:0.841682
[164]	validation_0-auc:0.864221	validation_1-auc:0.841791
[165]	validation_0-auc:0.86426	validation_1-auc:0.841732
[166]	validation_0-auc:0.864309	validation_1-auc:0.841688
[167]	validation_0-auc:0.864411	validation_1-auc:0.841699
[168]	validation_0-auc:0.864581	validation_1-auc:0.841711
[169]	validation_0-auc:0.864619	validation_1-auc:0.841729
[170]	validation_0-auc:0.864709	validation_1-auc:0.841684
[171]	validation_0-auc:0.864849	validation_1-auc:0.841704
[172]	validation_0-auc:0.865047	validation_1-auc:0.841614
[173]	validation_0-auc:0.865085	validation_1-auc:0.84162
[174]	validation_0-auc:0.865321	validation_1-auc:0.841734
[175]	validation_0-auc:0.865523	validation_1-auc:0.8418
[176]	validation_0-auc:0.865766	validation_1-auc:0.841706
[177]	validation_0-auc:0.865925	validation_1-auc:0.841829
[178]	validation_0-auc:0.866004	validation_1-auc:0.841863
[179]	validation_0-auc:0.866111	validation_1-auc:0.841834
[180]	validation_0-auc:0.866196	validation_1-auc:0.841856
[181]	validation_0-auc:0.866366	validation_1-auc:0.841826
[182]	validation_0-auc:0.86643	validation_1-auc:0.841757
[183]	validation_0-auc:0.866606	validation_1-auc:0.841636
[184]	validation_0-auc:0.866827	validation_1-auc:0.8415
[185]	validation_0-auc:0.86688	validation_1-auc:0.841593
[186]	validation_0-auc:0.866935	validation_1-auc:0.841556
[187]	validation_0-auc:0.867004	validation_1-auc:0.84152
[188]	validation_0-auc:0.867048	validation_1-auc:0.841506
[189]	validation_0-auc:0.867219	validation_1-auc:0.841506
[190]	validation_0-auc:0.867274	validation_1-auc:0.841485
[191]	validation_0-auc:0.867332	validation_1-auc:0.841434
[192]	validation_0-auc:0.867393	validation_1-auc:0.841442
[193]	validation_0-auc:0.867493	validation_1-auc:0.841402
[194]	validation_0-auc:0.867554	validation_1-auc:0.841418
[195]	validation_0-auc:0.867612	validation_1-auc:0.841306
[196]	validation_0-auc:0.867653	validation_1-auc:0.841299
[197]	validation_0-auc:0.867884	validation_1-auc:0.841215
[198]	validation_0-auc:0.86792	validation_1-auc:0.841233
[199]	validation_0-auc:0.868009	validation_1-auc:0.841232
[200]	validation_0-auc:0.868041	validation_1-auc:0.841281
[201]	validation_0-auc:0.868068	validation_1-auc:0.841247
[202]	validation_0-auc:0.868219	validation_1-auc:0.841184
[203]	validation_0-auc:0.868387	validation_1-auc:0.841062
[204]	validation_0-auc:0.868541	validation_1-auc:0.841111
[205]	validation_0-auc:0.868656	validation_1-auc:0.84118
[206]	validation_0-auc:0.86874	validation_1-auc:0.8411
[207]	validation_0-auc:0.86877	validation_1-auc:0.841171
[208]	validation_0-auc:0.869001	validation_1-auc:0.841108
[209]	validation_0-auc:0.869076	validation_1-auc:0.841072
[210]	validation_0-auc:0.869226	validation_1-auc:0.841046
[211]	validation_0-auc:0.869248	validation_1-auc:0.841028
[212]	validation_0-auc:0.86931	validation_1-auc:0.840946
[213]	validation_0-auc:0.869368	validation_1-auc:0.84097
[214]	validation_0-auc:0.869392	validation_1-auc:0.840956
[215]	validation_0-auc:0.869424	validation_1-auc:0.840972
[216]	validation_0-auc:0.869623	validation_1-auc:0.841031
[217]	validation_0-auc:0.869782	validation_1-auc:0.841065
[218]	validation_0-auc:0.869946	validation_1-auc:0.841163
[219]	validation_0-auc:0.870121	validation_1-auc:0.841116
[220]	validation_0-auc:0.870264	validation_1-auc:0.84101
[221]	validation_0-auc:0.87038	validation_1-auc:0.840953
[222]	validation_0-auc:0.870521	validation_1-auc:0.841005
[223]	validation_0-auc:0.870696	validation_1-auc:0.8411
[224]	validation_0-auc:0.870835	validation_1-auc:0.841151
[225]	validation_0-auc:0.870946	validation_1-auc:0.841051
[226]	validation_0-auc:0.870993	validation_1-auc:0.841012
[227]	validation_0-auc:0.871048	validation_1-auc:0.841054
[228]	validation_0-auc:0.871088	validation_1-auc:0.841005
[229]	validation_0-auc:0.871115	validation_1-auc:0.84093
[230]	validation_0-auc:0.871159	validation_1-auc:0.840939
[231]	validation_0-auc:0.871225	validation_1-auc:0.840889
[232]	validation_0-auc:0.871284	validation_1-auc:0.840894
[233]	validation_0-auc:0.871308	validation_1-auc:0.840923
[234]	validation_0-auc:0.871376	validation_1-auc:0.841058
[235]	validation_0-auc:0.871439	validation_1-auc:0.841035
[236]	validation_0-auc:0.871638	validation_1-auc:0.841187
[237]	validation_0-auc:0.871762	validation_1-auc:0.841209
[238]	validation_0-auc:0.87184	validation_1-auc:0.841378
[239]	validation_0-auc:0.871884	validation_1-auc:0.841406
[240]	validation_0-auc:0.871987	validation_1-auc:0.841472
[241]	validation_0-auc:0.872169	validation_1-auc:0.841411
[242]	validation_0-auc:0.872259	validation_1-auc:0.841359
[243]	validation_0-auc:0.872465	validation_1-auc:0.841397
[244]	validation_0-auc:0.872518	validation_1-auc:0.84136
[245]	validation_0-auc:0.872531	validation_1-auc:0.841404
[246]	validation_0-auc:0.872555	validation_1-auc:0.841325
[247]	validation_0-auc:0.872693	validation_1-auc:0.841303
[248]	validation_0-auc:0.872905	validation_1-auc:0.841331
[249]	validation_0-auc:0.872917	validation_1-auc:0.841334
[250]	validation_0-auc:0.872945	validation_1-auc:0.841375
[251]	validation_0-auc:0.873042	validation_1-auc:0.841281
[252]	validation_0-auc:0.873125	validation_1-auc:0.841266
[253]	validation_0-auc:0.87328	validation_1-auc:0.841185
[254]	validation_0-auc:0.873296	validation_1-auc:0.841173
[255]	validation_0-auc:0.87335	validation_1-auc:0.841161
[256]	validation_0-auc:0.873377	validation_1-auc:0.841136
[257]	validation_0-auc:0.873481	validation_1-auc:0.841035
[258]	validation_0-auc:0.873558	validation_1-auc:0.840996
[259]	validation_0-auc:0.873674	validation_1-auc:0.840999
[260]	validation_0-auc:0.873779	validation_1-auc:0.841058
[261]	validation_0-auc:0.874002	validation_1-auc:0.841059
[262]	validation_0-auc:0.874125	validation_1-auc:0.841093
[263]	validation_0-auc:0.874144	validation_1-auc:0.841091
[264]	validation_0-auc:0.87417	validation_1-auc:0.841116
[265]	validation_0-auc:0.874196	validation_1-auc:0.841127
[266]	validation_0-auc:0.874238	validation_1-auc:0.841082
[267]	validation_0-auc:0.874271	validation_1-auc:0.841138
[268]	validation_0-auc:0.874298	validation_1-auc:0.841147
[269]	validation_0-auc:0.874343	validation_1-auc:0.841167
[270]	validation_0-auc:0.874417	validation_1-auc:0.841146
[271]	validation_0-auc:0.87444	validation_1-auc:0.841165
[272]	validation_0-auc:0.874479	validation_1-auc:0.841174
[273]	validation_0-auc:0.874482	validation_1-auc:0.841185
[274]	validation_0-auc:0.874647	validation_1-auc:0.841277
[275]	validation_0-auc:0.8747	validation_1-auc:0.841295
[276]	validation_0-auc:0.874743	validation_1-auc:0.841319
[277]	validation_0-auc:0.874795	validation_1-auc:0.841353
[278]	validation_0-auc:0.874858	validation_1-auc:0.841289
Stopping. Best iteration:
[178]	validation_0-auc:0.866004	validation_1-auc:0.841863

ROC_AUC : 0.8419

In [15]:

# 테스트 데이터로 예측시 ROC_AUC 약 0.8419

In [16]:

"""
하이퍼 파라미터 튜닝
칼럼 개수가 많아 과적합 가능성은 가정, max_depth, min_child_weight, colsample_bytree 만 튜닝
수행시간을 고려해 n_estimators=100, early_stopping_rounds=30 으로 설정 후 튜닝
"""


from sklearn.model_selection import GridSearchCV

# 하이퍼 파라미터 테스트의 수행 속도를 향상시키기 위해 n_estimators를 100으로 감소
xgb_clf = XGBClassifier(n_estimators=100)

params = {'max_depth':[5, 7] , 'min_child_weight':[1,3] ,'colsample_bytree':[0.5, 0.75] }

# 하이퍼 파라미터 테스트. 
gridcv = GridSearchCV(xgb_clf, param_grid=params, cv=3)
gridcv.fit(X_train, y_train, early_stopping_rounds=30, eval_metric="auc",
           eval_set=[(X_train, y_train), (X_test, y_test)])

print('GridSearchCV 최적 파라미터:',gridcv.best_params_) 

xgb_roc_score = roc_auc_score(y_test, gridcv.predict_proba(X_test)[:,1], average='macro')
print('ROC AUC: {0:.4f}'.format(xgb_roc_score))

[0]	validation_0-auc:0.715421	validation_1-auc:0.722463
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.802772	validation_1-auc:0.807648
[2]	validation_0-auc:0.800147	validation_1-auc:0.804566
[3]	validation_0-auc:0.805692	validation_1-auc:0.809325
[4]	validation_0-auc:0.814807	validation_1-auc:0.816951
[5]	validation_0-auc:0.810346	validation_1-auc:0.812634
[6]	validation_0-auc:0.810623	validation_1-auc:0.814491
[7]	validation_0-auc:0.818556	validation_1-auc:0.820561
[8]	validation_0-auc:0.822006	validation_1-auc:0.823553
[9]	validation_0-auc:0.820433	validation_1-auc:0.821292
[10]	validation_0-auc:0.826212	validation_1-auc:0.825279
[11]	validation_0-auc:0.830077	validation_1-auc:0.827817
[12]	validation_0-auc:0.832328	validation_1-auc:0.828775
[13]	validation_0-auc:0.832008	validation_1-auc:0.827865
[14]	validation_0-auc:0.830319	validation_1-auc:0.826745
[15]	validation_0-auc:0.832662	validation_1-auc:0.82862
[16]	validation_0-auc:0.836402	validation_1-auc:0.830562
[17]	validation_0-auc:0.839389	validation_1-auc:0.833342
[18]	validation_0-auc:0.840935	validation_1-auc:0.83416
[19]	validation_0-auc:0.8397	validation_1-auc:0.833319
[20]	validation_0-auc:0.841766	validation_1-auc:0.834575
[21]	validation_0-auc:0.841557	validation_1-auc:0.833945
[22]	validation_0-auc:0.84072	validation_1-auc:0.833423
[23]	validation_0-auc:0.842988	validation_1-auc:0.835829
[24]	validation_0-auc:0.845	validation_1-auc:0.83679
[25]	validation_0-auc:0.844931	validation_1-auc:0.83488
[26]	validation_0-auc:0.844354	validation_1-auc:0.834584
[27]	validation_0-auc:0.846588	validation_1-auc:0.835882
[28]	validation_0-auc:0.8484	validation_1-auc:0.837484
[29]	validation_0-auc:0.848132	validation_1-auc:0.837547
[30]	validation_0-auc:0.849419	validation_1-auc:0.838532
[31]	validation_0-auc:0.850688	validation_1-auc:0.839968
[32]	validation_0-auc:0.851162	validation_1-auc:0.839109
[33]	validation_0-auc:0.851777	validation_1-auc:0.839402
[34]	validation_0-auc:0.851699	validation_1-auc:0.838331
[35]	validation_0-auc:0.853705	validation_1-auc:0.838941
[36]	validation_0-auc:0.85468	validation_1-auc:0.839874
[37]	validation_0-auc:0.854706	validation_1-auc:0.839192
[38]	validation_0-auc:0.855186	validation_1-auc:0.838822
[39]	validation_0-auc:0.855418	validation_1-auc:0.838952
[40]	validation_0-auc:0.855755	validation_1-auc:0.838564
[41]	validation_0-auc:0.855727	validation_1-auc:0.837458
[42]	validation_0-auc:0.856843	validation_1-auc:0.838578
[43]	validation_0-auc:0.856872	validation_1-auc:0.838383
[44]	validation_0-auc:0.85825	validation_1-auc:0.838991
[45]	validation_0-auc:0.858271	validation_1-auc:0.838734
[46]	validation_0-auc:0.859118	validation_1-auc:0.839502
[47]	validation_0-auc:0.860039	validation_1-auc:0.840139
[48]	validation_0-auc:0.860313	validation_1-auc:0.840098
[49]	validation_0-auc:0.860882	validation_1-auc:0.839755
[50]	validation_0-auc:0.861258	validation_1-auc:0.839386
[51]	validation_0-auc:0.861784	validation_1-auc:0.839906
[52]	validation_0-auc:0.86235	validation_1-auc:0.840527
[53]	validation_0-auc:0.862796	validation_1-auc:0.84081
[54]	validation_0-auc:0.863283	validation_1-auc:0.841067
[55]	validation_0-auc:0.863833	validation_1-auc:0.841105
[56]	validation_0-auc:0.864191	validation_1-auc:0.841328
[57]	validation_0-auc:0.864541	validation_1-auc:0.841191
[58]	validation_0-auc:0.865053	validation_1-auc:0.841228
[59]	validation_0-auc:0.865072	validation_1-auc:0.841089
[60]	validation_0-auc:0.865493	validation_1-auc:0.840998
[61]	validation_0-auc:0.865725	validation_1-auc:0.840912
[62]	validation_0-auc:0.866	validation_1-auc:0.840736
[63]	validation_0-auc:0.866254	validation_1-auc:0.840737
[64]	validation_0-auc:0.866471	validation_1-auc:0.840486
[65]	validation_0-auc:0.866765	validation_1-auc:0.840402
[66]	validation_0-auc:0.866858	validation_1-auc:0.840233
[67]	validation_0-auc:0.867249	validation_1-auc:0.840349
[68]	validation_0-auc:0.867545	validation_1-auc:0.840429
[69]	validation_0-auc:0.86771	validation_1-auc:0.840205
[70]	validation_0-auc:0.867924	validation_1-auc:0.840111
[71]	validation_0-auc:0.868052	validation_1-auc:0.840097
[72]	validation_0-auc:0.868216	validation_1-auc:0.83997
[73]	validation_0-auc:0.868427	validation_1-auc:0.839994
[74]	validation_0-auc:0.868532	validation_1-auc:0.840142
[75]	validation_0-auc:0.868731	validation_1-auc:0.840173
[76]	validation_0-auc:0.868821	validation_1-auc:0.840157
[77]	validation_0-auc:0.868903	validation_1-auc:0.840192
[78]	validation_0-auc:0.86901	validation_1-auc:0.83997
[79]	validation_0-auc:0.869278	validation_1-auc:0.839669
[80]	validation_0-auc:0.86937	validation_1-auc:0.839491
[81]	validation_0-auc:0.869456	validation_1-auc:0.839451
[82]	validation_0-auc:0.869738	validation_1-auc:0.839396
[83]	validation_0-auc:0.870145	validation_1-auc:0.839452
[84]	validation_0-auc:0.870169	validation_1-auc:0.839349
[85]	validation_0-auc:0.870299	validation_1-auc:0.839386
[86]	validation_0-auc:0.870907	validation_1-auc:0.839362
Stopping. Best iteration:
[56]	validation_0-auc:0.864191	validation_1-auc:0.841328

[0]	validation_0-auc:0.717372	validation_1-auc:0.725803
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.811452	validation_1-auc:0.811759
[2]	validation_0-auc:0.804765	validation_1-auc:0.808258
[3]	validation_0-auc:0.814846	validation_1-auc:0.814141
[4]	validation_0-auc:0.823444	validation_1-auc:0.82262
[5]	validation_0-auc:0.817419	validation_1-auc:0.817272
[6]	validation_0-auc:0.816491	validation_1-auc:0.81621
[7]	validation_0-auc:0.823934	validation_1-auc:0.821007
[8]	validation_0-auc:0.827846	validation_1-auc:0.8252
[9]	validation_0-auc:0.82846	validation_1-auc:0.827067
[10]	validation_0-auc:0.831473	validation_1-auc:0.828246
[11]	validation_0-auc:0.834397	validation_1-auc:0.83073
[12]	validation_0-auc:0.836391	validation_1-auc:0.832251
[13]	validation_0-auc:0.835478	validation_1-auc:0.831521
[14]	validation_0-auc:0.835839	validation_1-auc:0.830979
[15]	validation_0-auc:0.837833	validation_1-auc:0.831883
[16]	validation_0-auc:0.840134	validation_1-auc:0.834495
[17]	validation_0-auc:0.842063	validation_1-auc:0.835636
[18]	validation_0-auc:0.845167	validation_1-auc:0.836936
[19]	validation_0-auc:0.84317	validation_1-auc:0.835238
[20]	validation_0-auc:0.844854	validation_1-auc:0.838582
[21]	validation_0-auc:0.844582	validation_1-auc:0.837593
[22]	validation_0-auc:0.843234	validation_1-auc:0.836389
[23]	validation_0-auc:0.844958	validation_1-auc:0.836951
[24]	validation_0-auc:0.845546	validation_1-auc:0.837745
[25]	validation_0-auc:0.845446	validation_1-auc:0.836673
[26]	validation_0-auc:0.845504	validation_1-auc:0.837039
[27]	validation_0-auc:0.847616	validation_1-auc:0.837946
[28]	validation_0-auc:0.849218	validation_1-auc:0.838594
[29]	validation_0-auc:0.849081	validation_1-auc:0.838931
[30]	validation_0-auc:0.850242	validation_1-auc:0.839849
[31]	validation_0-auc:0.851248	validation_1-auc:0.840555
[32]	validation_0-auc:0.852047	validation_1-auc:0.840215
[33]	validation_0-auc:0.851789	validation_1-auc:0.840088
[34]	validation_0-auc:0.851836	validation_1-auc:0.840203
[35]	validation_0-auc:0.854101	validation_1-auc:0.840857
[36]	validation_0-auc:0.855449	validation_1-auc:0.841436
[37]	validation_0-auc:0.855895	validation_1-auc:0.841578
[38]	validation_0-auc:0.856269	validation_1-auc:0.841228
[39]	validation_0-auc:0.856527	validation_1-auc:0.841361
[40]	validation_0-auc:0.856628	validation_1-auc:0.840503
[41]	validation_0-auc:0.856761	validation_1-auc:0.840695
[42]	validation_0-auc:0.85802	validation_1-auc:0.841438
[43]	validation_0-auc:0.858325	validation_1-auc:0.841047
[44]	validation_0-auc:0.859587	validation_1-auc:0.841786
[45]	validation_0-auc:0.859608	validation_1-auc:0.841748
[46]	validation_0-auc:0.860629	validation_1-auc:0.842253
[47]	validation_0-auc:0.861271	validation_1-auc:0.84256
[48]	validation_0-auc:0.861785	validation_1-auc:0.842465
[49]	validation_0-auc:0.862397	validation_1-auc:0.842109
[50]	validation_0-auc:0.862705	validation_1-auc:0.842593
[51]	validation_0-auc:0.86387	validation_1-auc:0.843007
[52]	validation_0-auc:0.864428	validation_1-auc:0.843608
[53]	validation_0-auc:0.86492	validation_1-auc:0.843887
[54]	validation_0-auc:0.865341	validation_1-auc:0.844128
[55]	validation_0-auc:0.865713	validation_1-auc:0.843955
[56]	validation_0-auc:0.866165	validation_1-auc:0.844301
[57]	validation_0-auc:0.866538	validation_1-auc:0.84439
[58]	validation_0-auc:0.86671	validation_1-auc:0.844055
[59]	validation_0-auc:0.866977	validation_1-auc:0.843974
[60]	validation_0-auc:0.867483	validation_1-auc:0.8439
[61]	validation_0-auc:0.867853	validation_1-auc:0.843561
[62]	validation_0-auc:0.86811	validation_1-auc:0.843594
[63]	validation_0-auc:0.868319	validation_1-auc:0.843498
[64]	validation_0-auc:0.868554	validation_1-auc:0.843615
[65]	validation_0-auc:0.869021	validation_1-auc:0.843756
[66]	validation_0-auc:0.869095	validation_1-auc:0.843781
[67]	validation_0-auc:0.869277	validation_1-auc:0.843635
[68]	validation_0-auc:0.869639	validation_1-auc:0.843286
[69]	validation_0-auc:0.869756	validation_1-auc:0.843157
[70]	validation_0-auc:0.869923	validation_1-auc:0.843385
[71]	validation_0-auc:0.870143	validation_1-auc:0.843476
[72]	validation_0-auc:0.870491	validation_1-auc:0.843311
[73]	validation_0-auc:0.870757	validation_1-auc:0.843377
[74]	validation_0-auc:0.870974	validation_1-auc:0.843152
[75]	validation_0-auc:0.871141	validation_1-auc:0.843309
[76]	validation_0-auc:0.871466	validation_1-auc:0.84333
[77]	validation_0-auc:0.871652	validation_1-auc:0.843404
[78]	validation_0-auc:0.872254	validation_1-auc:0.843261
[79]	validation_0-auc:0.872488	validation_1-auc:0.84337
[80]	validation_0-auc:0.872632	validation_1-auc:0.843503
[81]	validation_0-auc:0.872845	validation_1-auc:0.843434
[82]	validation_0-auc:0.872982	validation_1-auc:0.84341
[83]	validation_0-auc:0.873153	validation_1-auc:0.843339
[84]	validation_0-auc:0.873399	validation_1-auc:0.843315
[85]	validation_0-auc:0.873562	validation_1-auc:0.843577
[86]	validation_0-auc:0.873842	validation_1-auc:0.843366
[87]	validation_0-auc:0.874075	validation_1-auc:0.843301
Stopping. Best iteration:
[57]	validation_0-auc:0.866538	validation_1-auc:0.84439

[0]	validation_0-auc:0.728604	validation_1-auc:0.729138
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.815073	validation_1-auc:0.81486
[2]	validation_0-auc:0.807773	validation_1-auc:0.806289
[3]	validation_0-auc:0.821196	validation_1-auc:0.820953
[4]	validation_0-auc:0.826503	validation_1-auc:0.824375
[5]	validation_0-auc:0.824442	validation_1-auc:0.821261
[6]	validation_0-auc:0.820837	validation_1-auc:0.815853
[7]	validation_0-auc:0.828494	validation_1-auc:0.826392
[8]	validation_0-auc:0.832047	validation_1-auc:0.828695
[9]	validation_0-auc:0.831208	validation_1-auc:0.828754
[10]	validation_0-auc:0.833735	validation_1-auc:0.829758
[11]	validation_0-auc:0.83639	validation_1-auc:0.832338
[12]	validation_0-auc:0.837919	validation_1-auc:0.83245
[13]	validation_0-auc:0.83811	validation_1-auc:0.832029
[14]	validation_0-auc:0.83775	validation_1-auc:0.830778
[15]	validation_0-auc:0.839769	validation_1-auc:0.833849
[16]	validation_0-auc:0.841781	validation_1-auc:0.834353
[17]	validation_0-auc:0.844232	validation_1-auc:0.836176
[18]	validation_0-auc:0.845483	validation_1-auc:0.836733
[19]	validation_0-auc:0.844037	validation_1-auc:0.83578
[20]	validation_0-auc:0.844835	validation_1-auc:0.836975
[21]	validation_0-auc:0.844154	validation_1-auc:0.836806
[22]	validation_0-auc:0.843706	validation_1-auc:0.836371
[23]	validation_0-auc:0.846431	validation_1-auc:0.83695
[24]	validation_0-auc:0.847848	validation_1-auc:0.837788
[25]	validation_0-auc:0.848239	validation_1-auc:0.835882
[26]	validation_0-auc:0.847676	validation_1-auc:0.835369
[27]	validation_0-auc:0.849208	validation_1-auc:0.83703
[28]	validation_0-auc:0.850472	validation_1-auc:0.836861
[29]	validation_0-auc:0.850167	validation_1-auc:0.83635
[30]	validation_0-auc:0.851372	validation_1-auc:0.837438
[31]	validation_0-auc:0.85277	validation_1-auc:0.839114
[32]	validation_0-auc:0.852667	validation_1-auc:0.837985
[33]	validation_0-auc:0.852747	validation_1-auc:0.837668
[34]	validation_0-auc:0.852733	validation_1-auc:0.836907
[35]	validation_0-auc:0.854444	validation_1-auc:0.837927
[36]	validation_0-auc:0.855524	validation_1-auc:0.838667
[37]	validation_0-auc:0.855691	validation_1-auc:0.838458
[38]	validation_0-auc:0.855658	validation_1-auc:0.838405
[39]	validation_0-auc:0.855707	validation_1-auc:0.838205
[40]	validation_0-auc:0.855977	validation_1-auc:0.837566
[41]	validation_0-auc:0.85607	validation_1-auc:0.83725
[42]	validation_0-auc:0.857448	validation_1-auc:0.838628
[43]	validation_0-auc:0.858151	validation_1-auc:0.838294
[44]	validation_0-auc:0.859033	validation_1-auc:0.839502
[45]	validation_0-auc:0.85922	validation_1-auc:0.839211
[46]	validation_0-auc:0.860188	validation_1-auc:0.840069
[47]	validation_0-auc:0.860935	validation_1-auc:0.841387
[48]	validation_0-auc:0.861189	validation_1-auc:0.841403
[49]	validation_0-auc:0.861589	validation_1-auc:0.841071
[50]	validation_0-auc:0.861762	validation_1-auc:0.840556
[51]	validation_0-auc:0.862347	validation_1-auc:0.841358
[52]	validation_0-auc:0.8631	validation_1-auc:0.842024
[53]	validation_0-auc:0.863472	validation_1-auc:0.842581
[54]	validation_0-auc:0.864049	validation_1-auc:0.842295
[55]	validation_0-auc:0.864407	validation_1-auc:0.84224
[56]	validation_0-auc:0.864963	validation_1-auc:0.842305
[57]	validation_0-auc:0.865297	validation_1-auc:0.842521
[58]	validation_0-auc:0.865713	validation_1-auc:0.842384
[59]	validation_0-auc:0.865816	validation_1-auc:0.842552
[60]	validation_0-auc:0.866309	validation_1-auc:0.842857
[61]	validation_0-auc:0.866745	validation_1-auc:0.84279
[62]	validation_0-auc:0.867055	validation_1-auc:0.842625
[63]	validation_0-auc:0.867486	validation_1-auc:0.842366
[64]	validation_0-auc:0.867739	validation_1-auc:0.842438
[65]	validation_0-auc:0.86812	validation_1-auc:0.842509
[66]	validation_0-auc:0.868275	validation_1-auc:0.84245
[67]	validation_0-auc:0.868475	validation_1-auc:0.842675
[68]	validation_0-auc:0.868921	validation_1-auc:0.84256
[69]	validation_0-auc:0.869167	validation_1-auc:0.842877
[70]	validation_0-auc:0.869353	validation_1-auc:0.842964
[71]	validation_0-auc:0.869559	validation_1-auc:0.84313
[72]	validation_0-auc:0.869581	validation_1-auc:0.843128
[73]	validation_0-auc:0.869742	validation_1-auc:0.843138
[74]	validation_0-auc:0.869847	validation_1-auc:0.843219
[75]	validation_0-auc:0.870334	validation_1-auc:0.842997
[76]	validation_0-auc:0.870539	validation_1-auc:0.842974
[77]	validation_0-auc:0.870822	validation_1-auc:0.842953
[78]	validation_0-auc:0.871051	validation_1-auc:0.842888
[79]	validation_0-auc:0.87137	validation_1-auc:0.842864
[80]	validation_0-auc:0.87156	validation_1-auc:0.842791
[81]	validation_0-auc:0.871654	validation_1-auc:0.842734
[82]	validation_0-auc:0.871763	validation_1-auc:0.842652
[83]	validation_0-auc:0.872087	validation_1-auc:0.842457
[84]	validation_0-auc:0.872577	validation_1-auc:0.842658
[85]	validation_0-auc:0.872852	validation_1-auc:0.842697
[86]	validation_0-auc:0.87289	validation_1-auc:0.842703
[87]	validation_0-auc:0.873122	validation_1-auc:0.842825
[88]	validation_0-auc:0.873216	validation_1-auc:0.842852
[89]	validation_0-auc:0.873363	validation_1-auc:0.842857
[90]	validation_0-auc:0.873777	validation_1-auc:0.842797
[91]	validation_0-auc:0.873994	validation_1-auc:0.842627
[92]	validation_0-auc:0.874105	validation_1-auc:0.8426
[93]	validation_0-auc:0.874331	validation_1-auc:0.84256
[94]	validation_0-auc:0.874317	validation_1-auc:0.842543
[95]	validation_0-auc:0.874664	validation_1-auc:0.842427
[96]	validation_0-auc:0.875004	validation_1-auc:0.842522
[97]	validation_0-auc:0.875199	validation_1-auc:0.842392
[98]	validation_0-auc:0.875379	validation_1-auc:0.842241
[99]	validation_0-auc:0.875458	validation_1-auc:0.842186
[0]	validation_0-auc:0.714006	validation_1-auc:0.723827
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.804027	validation_1-auc:0.809028
[2]	validation_0-auc:0.796929	validation_1-auc:0.805684
[3]	validation_0-auc:0.80379	validation_1-auc:0.811591
[4]	validation_0-auc:0.811904	validation_1-auc:0.818375
[5]	validation_0-auc:0.808826	validation_1-auc:0.815714
[6]	validation_0-auc:0.809236	validation_1-auc:0.816054
[7]	validation_0-auc:0.818354	validation_1-auc:0.823376
[8]	validation_0-auc:0.822085	validation_1-auc:0.826164
[9]	validation_0-auc:0.82165	validation_1-auc:0.824633
[10]	validation_0-auc:0.825876	validation_1-auc:0.828152
[11]	validation_0-auc:0.830307	validation_1-auc:0.830536
[12]	validation_0-auc:0.832494	validation_1-auc:0.831414
[13]	validation_0-auc:0.832283	validation_1-auc:0.831058
[14]	validation_0-auc:0.830152	validation_1-auc:0.829388
[15]	validation_0-auc:0.833723	validation_1-auc:0.831545
[16]	validation_0-auc:0.835902	validation_1-auc:0.833087
[17]	validation_0-auc:0.838024	validation_1-auc:0.835309
[18]	validation_0-auc:0.840344	validation_1-auc:0.837179
[19]	validation_0-auc:0.839049	validation_1-auc:0.836139
[20]	validation_0-auc:0.841203	validation_1-auc:0.837819
[21]	validation_0-auc:0.840361	validation_1-auc:0.836718
[22]	validation_0-auc:0.839561	validation_1-auc:0.835582
[23]	validation_0-auc:0.841618	validation_1-auc:0.838028
[24]	validation_0-auc:0.843341	validation_1-auc:0.839799
[25]	validation_0-auc:0.843391	validation_1-auc:0.838075
[26]	validation_0-auc:0.842866	validation_1-auc:0.83713
[27]	validation_0-auc:0.844606	validation_1-auc:0.838438
[28]	validation_0-auc:0.846092	validation_1-auc:0.839683
[29]	validation_0-auc:0.845979	validation_1-auc:0.839799
[30]	validation_0-auc:0.847241	validation_1-auc:0.840766
[31]	validation_0-auc:0.848587	validation_1-auc:0.841709
[32]	validation_0-auc:0.848981	validation_1-auc:0.841487
[33]	validation_0-auc:0.849264	validation_1-auc:0.841241
[34]	validation_0-auc:0.849212	validation_1-auc:0.840329
[35]	validation_0-auc:0.851241	validation_1-auc:0.841195
[36]	validation_0-auc:0.852575	validation_1-auc:0.841505
[37]	validation_0-auc:0.852547	validation_1-auc:0.841355
[38]	validation_0-auc:0.85314	validation_1-auc:0.841067
[39]	validation_0-auc:0.853311	validation_1-auc:0.841314
[40]	validation_0-auc:0.853527	validation_1-auc:0.841051
[41]	validation_0-auc:0.853601	validation_1-auc:0.839969
[42]	validation_0-auc:0.854856	validation_1-auc:0.841155
[43]	validation_0-auc:0.854913	validation_1-auc:0.840479
[44]	validation_0-auc:0.856142	validation_1-auc:0.841371
[45]	validation_0-auc:0.855966	validation_1-auc:0.840721
[46]	validation_0-auc:0.856817	validation_1-auc:0.841295
[47]	validation_0-auc:0.857639	validation_1-auc:0.842198
[48]	validation_0-auc:0.858099	validation_1-auc:0.842221
[49]	validation_0-auc:0.858669	validation_1-auc:0.842566
[50]	validation_0-auc:0.858815	validation_1-auc:0.842503
[51]	validation_0-auc:0.859313	validation_1-auc:0.842574
[52]	validation_0-auc:0.859954	validation_1-auc:0.843229
[53]	validation_0-auc:0.860592	validation_1-auc:0.843562
[54]	validation_0-auc:0.861171	validation_1-auc:0.843808
[55]	validation_0-auc:0.861666	validation_1-auc:0.843678
[56]	validation_0-auc:0.862143	validation_1-auc:0.843724
[57]	validation_0-auc:0.862316	validation_1-auc:0.843731
[58]	validation_0-auc:0.862813	validation_1-auc:0.843668
[59]	validation_0-auc:0.86285	validation_1-auc:0.843629
[60]	validation_0-auc:0.863111	validation_1-auc:0.843447
[61]	validation_0-auc:0.86325	validation_1-auc:0.843266
[62]	validation_0-auc:0.863572	validation_1-auc:0.843325
[63]	validation_0-auc:0.863893	validation_1-auc:0.843405
[64]	validation_0-auc:0.864023	validation_1-auc:0.843241
[65]	validation_0-auc:0.864277	validation_1-auc:0.843226
[66]	validation_0-auc:0.864395	validation_1-auc:0.843192
[67]	validation_0-auc:0.864935	validation_1-auc:0.843118
[68]	validation_0-auc:0.865194	validation_1-auc:0.843091
[69]	validation_0-auc:0.86549	validation_1-auc:0.843234
[70]	validation_0-auc:0.865592	validation_1-auc:0.842962
[71]	validation_0-auc:0.865757	validation_1-auc:0.84296
[72]	validation_0-auc:0.865884	validation_1-auc:0.84311
[73]	validation_0-auc:0.86619	validation_1-auc:0.8427
[74]	validation_0-auc:0.866281	validation_1-auc:0.84285
[75]	validation_0-auc:0.866614	validation_1-auc:0.842769
[76]	validation_0-auc:0.866746	validation_1-auc:0.842839
[77]	validation_0-auc:0.866804	validation_1-auc:0.84271
[78]	validation_0-auc:0.866846	validation_1-auc:0.842684
[79]	validation_0-auc:0.867312	validation_1-auc:0.842814
[80]	validation_0-auc:0.867387	validation_1-auc:0.842789
[81]	validation_0-auc:0.867529	validation_1-auc:0.842763
[82]	validation_0-auc:0.867621	validation_1-auc:0.842855
[83]	validation_0-auc:0.867771	validation_1-auc:0.84291
[84]	validation_0-auc:0.867877	validation_1-auc:0.842798
Stopping. Best iteration:
[54]	validation_0-auc:0.861171	validation_1-auc:0.843808

[0]	validation_0-auc:0.717533	validation_1-auc:0.726673
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.809737	validation_1-auc:0.813894
[2]	validation_0-auc:0.804185	validation_1-auc:0.809283
[3]	validation_0-auc:0.814872	validation_1-auc:0.81617
[4]	validation_0-auc:0.823769	validation_1-auc:0.82343
[5]	validation_0-auc:0.818965	validation_1-auc:0.820901
[6]	validation_0-auc:0.81903	validation_1-auc:0.821548
[7]	validation_0-auc:0.826846	validation_1-auc:0.826696
[8]	validation_0-auc:0.830195	validation_1-auc:0.828696
[9]	validation_0-auc:0.829661	validation_1-auc:0.828928
[10]	validation_0-auc:0.832518	validation_1-auc:0.829908
[11]	validation_0-auc:0.835179	validation_1-auc:0.832456
[12]	validation_0-auc:0.837699	validation_1-auc:0.833503
[13]	validation_0-auc:0.836467	validation_1-auc:0.832825
[14]	validation_0-auc:0.835604	validation_1-auc:0.830822
[15]	validation_0-auc:0.83806	validation_1-auc:0.833208
[16]	validation_0-auc:0.83938	validation_1-auc:0.835308
[17]	validation_0-auc:0.841018	validation_1-auc:0.836883
[18]	validation_0-auc:0.84373	validation_1-auc:0.838469
[19]	validation_0-auc:0.842177	validation_1-auc:0.837276
[20]	validation_0-auc:0.843345	validation_1-auc:0.838065
[21]	validation_0-auc:0.843135	validation_1-auc:0.8371
[22]	validation_0-auc:0.842118	validation_1-auc:0.835909
[23]	validation_0-auc:0.843862	validation_1-auc:0.837196
[24]	validation_0-auc:0.84529	validation_1-auc:0.838929
[25]	validation_0-auc:0.844988	validation_1-auc:0.838024
[26]	validation_0-auc:0.844803	validation_1-auc:0.837647
[27]	validation_0-auc:0.846169	validation_1-auc:0.838627
[28]	validation_0-auc:0.847917	validation_1-auc:0.839415
[29]	validation_0-auc:0.847523	validation_1-auc:0.83953
[30]	validation_0-auc:0.848561	validation_1-auc:0.840212
[31]	validation_0-auc:0.849674	validation_1-auc:0.840677
[32]	validation_0-auc:0.849838	validation_1-auc:0.840618
[33]	validation_0-auc:0.849584	validation_1-auc:0.840339
[34]	validation_0-auc:0.850048	validation_1-auc:0.840066
[35]	validation_0-auc:0.852148	validation_1-auc:0.840805
[36]	validation_0-auc:0.853775	validation_1-auc:0.84152
[37]	validation_0-auc:0.853997	validation_1-auc:0.841906
[38]	validation_0-auc:0.854261	validation_1-auc:0.841776
[39]	validation_0-auc:0.854181	validation_1-auc:0.841344
[40]	validation_0-auc:0.854347	validation_1-auc:0.841343
[41]	validation_0-auc:0.854327	validation_1-auc:0.841162
[42]	validation_0-auc:0.855582	validation_1-auc:0.841623
[43]	validation_0-auc:0.855521	validation_1-auc:0.84146
[44]	validation_0-auc:0.856886	validation_1-auc:0.842484
[45]	validation_0-auc:0.856922	validation_1-auc:0.842148
[46]	validation_0-auc:0.857832	validation_1-auc:0.842456
[47]	validation_0-auc:0.858576	validation_1-auc:0.843202
[48]	validation_0-auc:0.8593	validation_1-auc:0.843058
[49]	validation_0-auc:0.859621	validation_1-auc:0.843327
[50]	validation_0-auc:0.859706	validation_1-auc:0.843458
[51]	validation_0-auc:0.860711	validation_1-auc:0.844193
[52]	validation_0-auc:0.861274	validation_1-auc:0.844891
[53]	validation_0-auc:0.861533	validation_1-auc:0.845114
[54]	validation_0-auc:0.862135	validation_1-auc:0.845359
[55]	validation_0-auc:0.862478	validation_1-auc:0.845206
[56]	validation_0-auc:0.862881	validation_1-auc:0.84531
[57]	validation_0-auc:0.863066	validation_1-auc:0.845717
[58]	validation_0-auc:0.863413	validation_1-auc:0.845678
[59]	validation_0-auc:0.863608	validation_1-auc:0.84581
[60]	validation_0-auc:0.86412	validation_1-auc:0.845891
[61]	validation_0-auc:0.864399	validation_1-auc:0.845775
[62]	validation_0-auc:0.864521	validation_1-auc:0.845851
[63]	validation_0-auc:0.864786	validation_1-auc:0.845721
[64]	validation_0-auc:0.865062	validation_1-auc:0.845821
[65]	validation_0-auc:0.865567	validation_1-auc:0.845831
[66]	validation_0-auc:0.865616	validation_1-auc:0.845926
[67]	validation_0-auc:0.865942	validation_1-auc:0.845591
[68]	validation_0-auc:0.866071	validation_1-auc:0.845562
[69]	validation_0-auc:0.866158	validation_1-auc:0.845375
[70]	validation_0-auc:0.866421	validation_1-auc:0.845291
[71]	validation_0-auc:0.866631	validation_1-auc:0.845063
[72]	validation_0-auc:0.866834	validation_1-auc:0.844927
[73]	validation_0-auc:0.867035	validation_1-auc:0.844978
[74]	validation_0-auc:0.867128	validation_1-auc:0.844953
[75]	validation_0-auc:0.867261	validation_1-auc:0.845003
[76]	validation_0-auc:0.867406	validation_1-auc:0.844968
[77]	validation_0-auc:0.867496	validation_1-auc:0.844996
[78]	validation_0-auc:0.867709	validation_1-auc:0.844813
[79]	validation_0-auc:0.867952	validation_1-auc:0.84476
[80]	validation_0-auc:0.868082	validation_1-auc:0.844955
[81]	validation_0-auc:0.868275	validation_1-auc:0.844928
[82]	validation_0-auc:0.868362	validation_1-auc:0.844934
[83]	validation_0-auc:0.868593	validation_1-auc:0.844857
[84]	validation_0-auc:0.868867	validation_1-auc:0.845157
[85]	validation_0-auc:0.869142	validation_1-auc:0.845128
[86]	validation_0-auc:0.869236	validation_1-auc:0.845188
[87]	validation_0-auc:0.869403	validation_1-auc:0.845108
[88]	validation_0-auc:0.869561	validation_1-auc:0.844889
[89]	validation_0-auc:0.869615	validation_1-auc:0.844902
[90]	validation_0-auc:0.869686	validation_1-auc:0.844648
[91]	validation_0-auc:0.869724	validation_1-auc:0.844774
[92]	validation_0-auc:0.869777	validation_1-auc:0.84473
[93]	validation_0-auc:0.869911	validation_1-auc:0.844727
[94]	validation_0-auc:0.870108	validation_1-auc:0.844602
[95]	validation_0-auc:0.870246	validation_1-auc:0.844558
[96]	validation_0-auc:0.870323	validation_1-auc:0.844601
Stopping. Best iteration:
[66]	validation_0-auc:0.865616	validation_1-auc:0.845926

[0]	validation_0-auc:0.733623	validation_1-auc:0.734145
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.814232	validation_1-auc:0.811655
[2]	validation_0-auc:0.805561	validation_1-auc:0.804015
[3]	validation_0-auc:0.820451	validation_1-auc:0.819236
[4]	validation_0-auc:0.826716	validation_1-auc:0.824224
[5]	validation_0-auc:0.824925	validation_1-auc:0.822642
[6]	validation_0-auc:0.820246	validation_1-auc:0.816653
[7]	validation_0-auc:0.828143	validation_1-auc:0.826545
[8]	validation_0-auc:0.831962	validation_1-auc:0.82775
[9]	validation_0-auc:0.830335	validation_1-auc:0.827463
[10]	validation_0-auc:0.833474	validation_1-auc:0.828139
[11]	validation_0-auc:0.836167	validation_1-auc:0.830859
[12]	validation_0-auc:0.838009	validation_1-auc:0.831159
[13]	validation_0-auc:0.838268	validation_1-auc:0.83096
[14]	validation_0-auc:0.837455	validation_1-auc:0.8298
[15]	validation_0-auc:0.83929	validation_1-auc:0.832429
[16]	validation_0-auc:0.840689	validation_1-auc:0.833029
[17]	validation_0-auc:0.842391	validation_1-auc:0.835143
[18]	validation_0-auc:0.844267	validation_1-auc:0.836015
[19]	validation_0-auc:0.842744	validation_1-auc:0.834529
[20]	validation_0-auc:0.843683	validation_1-auc:0.836281
[21]	validation_0-auc:0.843302	validation_1-auc:0.835885
[22]	validation_0-auc:0.842219	validation_1-auc:0.834206
[23]	validation_0-auc:0.844107	validation_1-auc:0.835855
[24]	validation_0-auc:0.845733	validation_1-auc:0.836809
[25]	validation_0-auc:0.845846	validation_1-auc:0.835169
[26]	validation_0-auc:0.845368	validation_1-auc:0.834639
[27]	validation_0-auc:0.847065	validation_1-auc:0.836159
[28]	validation_0-auc:0.848717	validation_1-auc:0.836661
[29]	validation_0-auc:0.848539	validation_1-auc:0.836204
[30]	validation_0-auc:0.849871	validation_1-auc:0.837033
[31]	validation_0-auc:0.851462	validation_1-auc:0.838869
[32]	validation_0-auc:0.851693	validation_1-auc:0.838194
[33]	validation_0-auc:0.851787	validation_1-auc:0.837591
[34]	validation_0-auc:0.851261	validation_1-auc:0.837321
[35]	validation_0-auc:0.853008	validation_1-auc:0.837602
[36]	validation_0-auc:0.853928	validation_1-auc:0.839034
[37]	validation_0-auc:0.853967	validation_1-auc:0.838995
[38]	validation_0-auc:0.854107	validation_1-auc:0.838693
[39]	validation_0-auc:0.85407	validation_1-auc:0.838256
[40]	validation_0-auc:0.854572	validation_1-auc:0.838009
[41]	validation_0-auc:0.854346	validation_1-auc:0.837944
[42]	validation_0-auc:0.855443	validation_1-auc:0.839019
[43]	validation_0-auc:0.855744	validation_1-auc:0.838948
[44]	validation_0-auc:0.856792	validation_1-auc:0.839923
[45]	validation_0-auc:0.856881	validation_1-auc:0.839774
[46]	validation_0-auc:0.857732	validation_1-auc:0.840868
[47]	validation_0-auc:0.858398	validation_1-auc:0.841894
[48]	validation_0-auc:0.858981	validation_1-auc:0.841453
[49]	validation_0-auc:0.859433	validation_1-auc:0.841181
[50]	validation_0-auc:0.859344	validation_1-auc:0.840999
[51]	validation_0-auc:0.860303	validation_1-auc:0.842062
[52]	validation_0-auc:0.861083	validation_1-auc:0.842759
[53]	validation_0-auc:0.861582	validation_1-auc:0.842824
[54]	validation_0-auc:0.861882	validation_1-auc:0.84348
[55]	validation_0-auc:0.862181	validation_1-auc:0.843306
[56]	validation_0-auc:0.862584	validation_1-auc:0.843352
[57]	validation_0-auc:0.863002	validation_1-auc:0.843594
[58]	validation_0-auc:0.863051	validation_1-auc:0.843532
[59]	validation_0-auc:0.863067	validation_1-auc:0.843645
[60]	validation_0-auc:0.863458	validation_1-auc:0.84372
[61]	validation_0-auc:0.863797	validation_1-auc:0.843751
[62]	validation_0-auc:0.864259	validation_1-auc:0.844117
[63]	validation_0-auc:0.864593	validation_1-auc:0.84417
[64]	validation_0-auc:0.864937	validation_1-auc:0.84409
[65]	validation_0-auc:0.865491	validation_1-auc:0.844022
[66]	validation_0-auc:0.865495	validation_1-auc:0.844146
[67]	validation_0-auc:0.865839	validation_1-auc:0.844022
[68]	validation_0-auc:0.866271	validation_1-auc:0.843984
[69]	validation_0-auc:0.866407	validation_1-auc:0.843977
[70]	validation_0-auc:0.866618	validation_1-auc:0.843892
[71]	validation_0-auc:0.866861	validation_1-auc:0.844078
[72]	validation_0-auc:0.866983	validation_1-auc:0.844067
[73]	validation_0-auc:0.867219	validation_1-auc:0.844193
[74]	validation_0-auc:0.8675	validation_1-auc:0.844502
[75]	validation_0-auc:0.867775	validation_1-auc:0.844501
[76]	validation_0-auc:0.868026	validation_1-auc:0.844347
[77]	validation_0-auc:0.868407	validation_1-auc:0.844345
[78]	validation_0-auc:0.868502	validation_1-auc:0.844481
[79]	validation_0-auc:0.868876	validation_1-auc:0.844508
[80]	validation_0-auc:0.869069	validation_1-auc:0.844498
[81]	validation_0-auc:0.869287	validation_1-auc:0.844366
[82]	validation_0-auc:0.869628	validation_1-auc:0.844635
[83]	validation_0-auc:0.869831	validation_1-auc:0.844432
[84]	validation_0-auc:0.870237	validation_1-auc:0.844469
[85]	validation_0-auc:0.870455	validation_1-auc:0.844428
[86]	validation_0-auc:0.870567	validation_1-auc:0.844456
[87]	validation_0-auc:0.870776	validation_1-auc:0.844275
[88]	validation_0-auc:0.870884	validation_1-auc:0.844278
[89]	validation_0-auc:0.870985	validation_1-auc:0.844299
[90]	validation_0-auc:0.871421	validation_1-auc:0.844561
[91]	validation_0-auc:0.871615	validation_1-auc:0.844774
[92]	validation_0-auc:0.871698	validation_1-auc:0.844689
[93]	validation_0-auc:0.87192	validation_1-auc:0.844697
[94]	validation_0-auc:0.872237	validation_1-auc:0.845012
[95]	validation_0-auc:0.872387	validation_1-auc:0.844927
[96]	validation_0-auc:0.872522	validation_1-auc:0.8449
[97]	validation_0-auc:0.872666	validation_1-auc:0.844818
[98]	validation_0-auc:0.872729	validation_1-auc:0.844783
[99]	validation_0-auc:0.872827	validation_1-auc:0.844876
[0]	validation_0-auc:0.721496	validation_1-auc:0.726707
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.809965	validation_1-auc:0.808886
[2]	validation_0-auc:0.804423	validation_1-auc:0.807373
[3]	validation_0-auc:0.815189	validation_1-auc:0.816603
[4]	validation_0-auc:0.824234	validation_1-auc:0.823278
[5]	validation_0-auc:0.819568	validation_1-auc:0.81934
[6]	validation_0-auc:0.819199	validation_1-auc:0.818772
[7]	validation_0-auc:0.827364	validation_1-auc:0.826183
[8]	validation_0-auc:0.831947	validation_1-auc:0.829293
[9]	validation_0-auc:0.832248	validation_1-auc:0.827116
[10]	validation_0-auc:0.836511	validation_1-auc:0.829685
[11]	validation_0-auc:0.841032	validation_1-auc:0.831312
[12]	validation_0-auc:0.843673	validation_1-auc:0.831989
[13]	validation_0-auc:0.843697	validation_1-auc:0.832132
[14]	validation_0-auc:0.843356	validation_1-auc:0.830392
[15]	validation_0-auc:0.846759	validation_1-auc:0.832371
[16]	validation_0-auc:0.849031	validation_1-auc:0.835084
[17]	validation_0-auc:0.851348	validation_1-auc:0.836316
[18]	validation_0-auc:0.85355	validation_1-auc:0.836325
[19]	validation_0-auc:0.852407	validation_1-auc:0.835902
[20]	validation_0-auc:0.855592	validation_1-auc:0.836894
[21]	validation_0-auc:0.855578	validation_1-auc:0.836338
[22]	validation_0-auc:0.855055	validation_1-auc:0.834362
[23]	validation_0-auc:0.856969	validation_1-auc:0.836256
[24]	validation_0-auc:0.859067	validation_1-auc:0.837898
[25]	validation_0-auc:0.859464	validation_1-auc:0.836324
[26]	validation_0-auc:0.860391	validation_1-auc:0.836256
[27]	validation_0-auc:0.862288	validation_1-auc:0.837648
[28]	validation_0-auc:0.864212	validation_1-auc:0.837832
[29]	validation_0-auc:0.863904	validation_1-auc:0.837949
[30]	validation_0-auc:0.865373	validation_1-auc:0.838325
[31]	validation_0-auc:0.866804	validation_1-auc:0.839286
[32]	validation_0-auc:0.867114	validation_1-auc:0.838461
[33]	validation_0-auc:0.867559	validation_1-auc:0.837837
[34]	validation_0-auc:0.867666	validation_1-auc:0.836562
[35]	validation_0-auc:0.869961	validation_1-auc:0.836628
[36]	validation_0-auc:0.871011	validation_1-auc:0.836577
[37]	validation_0-auc:0.870972	validation_1-auc:0.836148
[38]	validation_0-auc:0.871422	validation_1-auc:0.835722
[39]	validation_0-auc:0.871905	validation_1-auc:0.835613
[40]	validation_0-auc:0.872281	validation_1-auc:0.834827
[41]	validation_0-auc:0.872395	validation_1-auc:0.833926
[42]	validation_0-auc:0.873852	validation_1-auc:0.834892
[43]	validation_0-auc:0.874157	validation_1-auc:0.834373
[44]	validation_0-auc:0.875648	validation_1-auc:0.835129
[45]	validation_0-auc:0.875628	validation_1-auc:0.834753
[46]	validation_0-auc:0.877231	validation_1-auc:0.835616
[47]	validation_0-auc:0.878061	validation_1-auc:0.836021
[48]	validation_0-auc:0.878547	validation_1-auc:0.835514
[49]	validation_0-auc:0.879086	validation_1-auc:0.835455
[50]	validation_0-auc:0.879127	validation_1-auc:0.835129
[51]	validation_0-auc:0.88007	validation_1-auc:0.835644
[52]	validation_0-auc:0.880714	validation_1-auc:0.836443
[53]	validation_0-auc:0.881303	validation_1-auc:0.836826
[54]	validation_0-auc:0.882146	validation_1-auc:0.837447
[55]	validation_0-auc:0.882624	validation_1-auc:0.837519
[56]	validation_0-auc:0.883443	validation_1-auc:0.837945
[57]	validation_0-auc:0.883778	validation_1-auc:0.838073
[58]	validation_0-auc:0.883954	validation_1-auc:0.837795
[59]	validation_0-auc:0.884016	validation_1-auc:0.837775
[60]	validation_0-auc:0.884359	validation_1-auc:0.837802
[61]	validation_0-auc:0.884522	validation_1-auc:0.837715
Stopping. Best iteration:
[31]	validation_0-auc:0.866804	validation_1-auc:0.839286

[0]	validation_0-auc:0.721852	validation_1-auc:0.729741
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.824968	validation_1-auc:0.818662
[2]	validation_0-auc:0.811627	validation_1-auc:0.807607
[3]	validation_0-auc:0.82329	validation_1-auc:0.817608
[4]	validation_0-auc:0.833891	validation_1-auc:0.827183
[5]	validation_0-auc:0.829346	validation_1-auc:0.823173
[6]	validation_0-auc:0.830657	validation_1-auc:0.823193
[7]	validation_0-auc:0.837086	validation_1-auc:0.828277
[8]	validation_0-auc:0.841806	validation_1-auc:0.831828
[9]	validation_0-auc:0.841538	validation_1-auc:0.830374
[10]	validation_0-auc:0.845563	validation_1-auc:0.83196
[11]	validation_0-auc:0.84837	validation_1-auc:0.833777
[12]	validation_0-auc:0.850042	validation_1-auc:0.835125
[13]	validation_0-auc:0.849995	validation_1-auc:0.834788
[14]	validation_0-auc:0.849859	validation_1-auc:0.834909
[15]	validation_0-auc:0.851605	validation_1-auc:0.836277
[16]	validation_0-auc:0.853452	validation_1-auc:0.837431
[17]	validation_0-auc:0.855172	validation_1-auc:0.838325
[18]	validation_0-auc:0.857132	validation_1-auc:0.839208
[19]	validation_0-auc:0.8564	validation_1-auc:0.837968
[20]	validation_0-auc:0.858287	validation_1-auc:0.839085
[21]	validation_0-auc:0.858191	validation_1-auc:0.838306
[22]	validation_0-auc:0.857245	validation_1-auc:0.837761
[23]	validation_0-auc:0.859056	validation_1-auc:0.837954
[24]	validation_0-auc:0.860289	validation_1-auc:0.839127
[25]	validation_0-auc:0.860264	validation_1-auc:0.8387
[26]	validation_0-auc:0.860721	validation_1-auc:0.837906
[27]	validation_0-auc:0.862613	validation_1-auc:0.838745
[28]	validation_0-auc:0.865302	validation_1-auc:0.839211
[29]	validation_0-auc:0.865292	validation_1-auc:0.839237
[30]	validation_0-auc:0.867375	validation_1-auc:0.840455
[31]	validation_0-auc:0.86852	validation_1-auc:0.840871
[32]	validation_0-auc:0.868741	validation_1-auc:0.841175
[33]	validation_0-auc:0.869048	validation_1-auc:0.840628
[34]	validation_0-auc:0.869342	validation_1-auc:0.840729
[35]	validation_0-auc:0.871566	validation_1-auc:0.841219
[36]	validation_0-auc:0.873492	validation_1-auc:0.840915
[37]	validation_0-auc:0.874299	validation_1-auc:0.840465
[38]	validation_0-auc:0.874655	validation_1-auc:0.840485
[39]	validation_0-auc:0.874847	validation_1-auc:0.840203
[40]	validation_0-auc:0.875159	validation_1-auc:0.840102
[41]	validation_0-auc:0.875529	validation_1-auc:0.839511
[42]	validation_0-auc:0.877026	validation_1-auc:0.840488
[43]	validation_0-auc:0.877419	validation_1-auc:0.840208
[44]	validation_0-auc:0.879016	validation_1-auc:0.84099
[45]	validation_0-auc:0.879153	validation_1-auc:0.840842
[46]	validation_0-auc:0.880492	validation_1-auc:0.841556
[47]	validation_0-auc:0.881414	validation_1-auc:0.842307
[48]	validation_0-auc:0.881847	validation_1-auc:0.841924
[49]	validation_0-auc:0.882674	validation_1-auc:0.841676
[50]	validation_0-auc:0.882941	validation_1-auc:0.841496
[51]	validation_0-auc:0.884039	validation_1-auc:0.841947
[52]	validation_0-auc:0.884793	validation_1-auc:0.84327
[53]	validation_0-auc:0.885307	validation_1-auc:0.843731
[54]	validation_0-auc:0.885993	validation_1-auc:0.844561
[55]	validation_0-auc:0.886369	validation_1-auc:0.844176
[56]	validation_0-auc:0.886916	validation_1-auc:0.844708
[57]	validation_0-auc:0.887549	validation_1-auc:0.844807
[58]	validation_0-auc:0.887958	validation_1-auc:0.844422
[59]	validation_0-auc:0.888112	validation_1-auc:0.844511
[60]	validation_0-auc:0.888529	validation_1-auc:0.844899
[61]	validation_0-auc:0.88888	validation_1-auc:0.844656
[62]	validation_0-auc:0.889315	validation_1-auc:0.845129
[63]	validation_0-auc:0.889722	validation_1-auc:0.845171
[64]	validation_0-auc:0.889863	validation_1-auc:0.845192
[65]	validation_0-auc:0.890132	validation_1-auc:0.845061
[66]	validation_0-auc:0.890207	validation_1-auc:0.845071
[67]	validation_0-auc:0.890589	validation_1-auc:0.845307
[68]	validation_0-auc:0.89087	validation_1-auc:0.845047
[69]	validation_0-auc:0.891118	validation_1-auc:0.844989
[70]	validation_0-auc:0.89132	validation_1-auc:0.845042
[71]	validation_0-auc:0.891877	validation_1-auc:0.844889
[72]	validation_0-auc:0.892046	validation_1-auc:0.844716
[73]	validation_0-auc:0.892287	validation_1-auc:0.844496
[74]	validation_0-auc:0.892425	validation_1-auc:0.844489
[75]	validation_0-auc:0.892746	validation_1-auc:0.84455
[76]	validation_0-auc:0.892764	validation_1-auc:0.844444
[77]	validation_0-auc:0.892957	validation_1-auc:0.844356
[78]	validation_0-auc:0.893228	validation_1-auc:0.84433
[79]	validation_0-auc:0.893375	validation_1-auc:0.844108
[80]	validation_0-auc:0.893476	validation_1-auc:0.844037
[81]	validation_0-auc:0.893656	validation_1-auc:0.844067
[82]	validation_0-auc:0.893838	validation_1-auc:0.843845
[83]	validation_0-auc:0.894993	validation_1-auc:0.84388
[84]	validation_0-auc:0.895174	validation_1-auc:0.843781
[85]	validation_0-auc:0.895171	validation_1-auc:0.844018
[86]	validation_0-auc:0.895293	validation_1-auc:0.843721
[87]	validation_0-auc:0.895377	validation_1-auc:0.843689
[88]	validation_0-auc:0.895614	validation_1-auc:0.8435
[89]	validation_0-auc:0.895597	validation_1-auc:0.84341
[90]	validation_0-auc:0.896023	validation_1-auc:0.843738
[91]	validation_0-auc:0.896194	validation_1-auc:0.843675
[92]	validation_0-auc:0.896304	validation_1-auc:0.843666
[93]	validation_0-auc:0.896388	validation_1-auc:0.8436
[94]	validation_0-auc:0.89645	validation_1-auc:0.843586
[95]	validation_0-auc:0.896973	validation_1-auc:0.843312
[96]	validation_0-auc:0.897076	validation_1-auc:0.843296
[97]	validation_0-auc:0.897856	validation_1-auc:0.843375
Stopping. Best iteration:
[67]	validation_0-auc:0.890589	validation_1-auc:0.845307

[0]	validation_0-auc:0.736837	validation_1-auc:0.734096
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.822075	validation_1-auc:0.815713
[2]	validation_0-auc:0.814378	validation_1-auc:0.806912
[3]	validation_0-auc:0.828328	validation_1-auc:0.821227
[4]	validation_0-auc:0.832905	validation_1-auc:0.82557
[5]	validation_0-auc:0.82954	validation_1-auc:0.82286
[6]	validation_0-auc:0.830212	validation_1-auc:0.822257
[7]	validation_0-auc:0.83366	validation_1-auc:0.825984
[8]	validation_0-auc:0.839052	validation_1-auc:0.82913
[9]	validation_0-auc:0.838785	validation_1-auc:0.828546
[10]	validation_0-auc:0.843474	validation_1-auc:0.83089
[11]	validation_0-auc:0.845716	validation_1-auc:0.833826
[12]	validation_0-auc:0.847837	validation_1-auc:0.835021
[13]	validation_0-auc:0.848858	validation_1-auc:0.834504
[14]	validation_0-auc:0.849274	validation_1-auc:0.833858
[15]	validation_0-auc:0.850754	validation_1-auc:0.835603
[16]	validation_0-auc:0.853107	validation_1-auc:0.836578
[17]	validation_0-auc:0.854776	validation_1-auc:0.83825
[18]	validation_0-auc:0.856721	validation_1-auc:0.838449
[19]	validation_0-auc:0.856305	validation_1-auc:0.837239
[20]	validation_0-auc:0.857456	validation_1-auc:0.837848
[21]	validation_0-auc:0.858567	validation_1-auc:0.837478
[22]	validation_0-auc:0.858185	validation_1-auc:0.837257
[23]	validation_0-auc:0.859682	validation_1-auc:0.837975
[24]	validation_0-auc:0.860729	validation_1-auc:0.838836
[25]	validation_0-auc:0.861018	validation_1-auc:0.838141
[26]	validation_0-auc:0.861195	validation_1-auc:0.837487
[27]	validation_0-auc:0.862986	validation_1-auc:0.838746
[28]	validation_0-auc:0.864711	validation_1-auc:0.838145
[29]	validation_0-auc:0.865095	validation_1-auc:0.83789
[30]	validation_0-auc:0.866268	validation_1-auc:0.838582
[31]	validation_0-auc:0.868945	validation_1-auc:0.839953
[32]	validation_0-auc:0.869195	validation_1-auc:0.838404
[33]	validation_0-auc:0.86929	validation_1-auc:0.838393
[34]	validation_0-auc:0.869764	validation_1-auc:0.837902
[35]	validation_0-auc:0.871924	validation_1-auc:0.838777
[36]	validation_0-auc:0.873955	validation_1-auc:0.839258
[37]	validation_0-auc:0.873879	validation_1-auc:0.838305
[38]	validation_0-auc:0.874233	validation_1-auc:0.838635
[39]	validation_0-auc:0.87411	validation_1-auc:0.838559
[40]	validation_0-auc:0.874665	validation_1-auc:0.837974
[41]	validation_0-auc:0.874859	validation_1-auc:0.837601
[42]	validation_0-auc:0.876514	validation_1-auc:0.839142
[43]	validation_0-auc:0.877022	validation_1-auc:0.837588
[44]	validation_0-auc:0.877958	validation_1-auc:0.839181
[45]	validation_0-auc:0.878217	validation_1-auc:0.838371
[46]	validation_0-auc:0.879275	validation_1-auc:0.83943
[47]	validation_0-auc:0.880126	validation_1-auc:0.840181
[48]	validation_0-auc:0.880644	validation_1-auc:0.840432
[49]	validation_0-auc:0.881244	validation_1-auc:0.839908
[50]	validation_0-auc:0.88159	validation_1-auc:0.839481
[51]	validation_0-auc:0.88245	validation_1-auc:0.840332
[52]	validation_0-auc:0.883218	validation_1-auc:0.841567
[53]	validation_0-auc:0.883587	validation_1-auc:0.842137
[54]	validation_0-auc:0.884225	validation_1-auc:0.84312
[55]	validation_0-auc:0.884796	validation_1-auc:0.842681
[56]	validation_0-auc:0.885435	validation_1-auc:0.842759
[57]	validation_0-auc:0.885805	validation_1-auc:0.843069
[58]	validation_0-auc:0.88599	validation_1-auc:0.84302
[59]	validation_0-auc:0.886291	validation_1-auc:0.842994
[60]	validation_0-auc:0.886702	validation_1-auc:0.842943
[61]	validation_0-auc:0.887043	validation_1-auc:0.843067
[62]	validation_0-auc:0.887658	validation_1-auc:0.842986
[63]	validation_0-auc:0.888136	validation_1-auc:0.842724
[64]	validation_0-auc:0.888304	validation_1-auc:0.842862
[65]	validation_0-auc:0.888781	validation_1-auc:0.842881
[66]	validation_0-auc:0.888818	validation_1-auc:0.842784
[67]	validation_0-auc:0.889112	validation_1-auc:0.842866
[68]	validation_0-auc:0.88954	validation_1-auc:0.842724
[69]	validation_0-auc:0.889782	validation_1-auc:0.843137
[70]	validation_0-auc:0.890054	validation_1-auc:0.843244
[71]	validation_0-auc:0.8904	validation_1-auc:0.843429
[72]	validation_0-auc:0.890421	validation_1-auc:0.843302
[73]	validation_0-auc:0.890522	validation_1-auc:0.843296
[74]	validation_0-auc:0.890696	validation_1-auc:0.843138
[75]	validation_0-auc:0.891228	validation_1-auc:0.84305
[76]	validation_0-auc:0.891385	validation_1-auc:0.843135
[77]	validation_0-auc:0.891696	validation_1-auc:0.843313
[78]	validation_0-auc:0.892108	validation_1-auc:0.842961
[79]	validation_0-auc:0.892415	validation_1-auc:0.84296
[80]	validation_0-auc:0.892525	validation_1-auc:0.842838
[81]	validation_0-auc:0.892587	validation_1-auc:0.842957
[82]	validation_0-auc:0.892676	validation_1-auc:0.842868
[83]	validation_0-auc:0.8931	validation_1-auc:0.842723
[84]	validation_0-auc:0.893336	validation_1-auc:0.842584
[85]	validation_0-auc:0.893412	validation_1-auc:0.842546
[86]	validation_0-auc:0.893478	validation_1-auc:0.842503
[87]	validation_0-auc:0.893648	validation_1-auc:0.842702
[88]	validation_0-auc:0.893826	validation_1-auc:0.84267
[89]	validation_0-auc:0.893879	validation_1-auc:0.842638
[90]	validation_0-auc:0.894313	validation_1-auc:0.842514
[91]	validation_0-auc:0.894686	validation_1-auc:0.842494
[92]	validation_0-auc:0.894798	validation_1-auc:0.84253
[93]	validation_0-auc:0.894806	validation_1-auc:0.842548
[94]	validation_0-auc:0.894932	validation_1-auc:0.842466
[95]	validation_0-auc:0.894964	validation_1-auc:0.842348
[96]	validation_0-auc:0.89511	validation_1-auc:0.842204
[97]	validation_0-auc:0.895132	validation_1-auc:0.842239
[98]	validation_0-auc:0.895264	validation_1-auc:0.842069
[99]	validation_0-auc:0.895378	validation_1-auc:0.842211
[0]	validation_0-auc:0.717208	validation_1-auc:0.727812
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.809957	validation_1-auc:0.813173
[2]	validation_0-auc:0.804055	validation_1-auc:0.809725
[3]	validation_0-auc:0.81577	validation_1-auc:0.82072
[4]	validation_0-auc:0.824793	validation_1-auc:0.827543
[5]	validation_0-auc:0.819261	validation_1-auc:0.823103
[6]	validation_0-auc:0.820551	validation_1-auc:0.824133
[7]	validation_0-auc:0.827873	validation_1-auc:0.830089
[8]	validation_0-auc:0.832632	validation_1-auc:0.833063
[9]	validation_0-auc:0.83316	validation_1-auc:0.830918
[10]	validation_0-auc:0.837133	validation_1-auc:0.833035
[11]	validation_0-auc:0.840495	validation_1-auc:0.834788
[12]	validation_0-auc:0.842871	validation_1-auc:0.835318
[13]	validation_0-auc:0.843048	validation_1-auc:0.833392
[14]	validation_0-auc:0.841936	validation_1-auc:0.831048
[15]	validation_0-auc:0.845077	validation_1-auc:0.833094
[16]	validation_0-auc:0.847639	validation_1-auc:0.83394
[17]	validation_0-auc:0.85058	validation_1-auc:0.835537
[18]	validation_0-auc:0.852488	validation_1-auc:0.836913
[19]	validation_0-auc:0.851413	validation_1-auc:0.83678
[20]	validation_0-auc:0.853824	validation_1-auc:0.837786
[21]	validation_0-auc:0.853711	validation_1-auc:0.836986
[22]	validation_0-auc:0.852989	validation_1-auc:0.835059
[23]	validation_0-auc:0.855112	validation_1-auc:0.836803
[24]	validation_0-auc:0.856859	validation_1-auc:0.838802
[25]	validation_0-auc:0.85723	validation_1-auc:0.83782
[26]	validation_0-auc:0.857535	validation_1-auc:0.836375
[27]	validation_0-auc:0.85929	validation_1-auc:0.837784
[28]	validation_0-auc:0.860972	validation_1-auc:0.837979
[29]	validation_0-auc:0.860682	validation_1-auc:0.837827
[30]	validation_0-auc:0.862143	validation_1-auc:0.838806
[31]	validation_0-auc:0.863184	validation_1-auc:0.839024
[32]	validation_0-auc:0.863638	validation_1-auc:0.838132
[33]	validation_0-auc:0.864268	validation_1-auc:0.838288
[34]	validation_0-auc:0.8644	validation_1-auc:0.837221
[35]	validation_0-auc:0.866468	validation_1-auc:0.83754
[36]	validation_0-auc:0.868094	validation_1-auc:0.837253
[37]	validation_0-auc:0.868158	validation_1-auc:0.836198
[38]	validation_0-auc:0.86853	validation_1-auc:0.83631
[39]	validation_0-auc:0.868816	validation_1-auc:0.835584
[40]	validation_0-auc:0.869055	validation_1-auc:0.835015
[41]	validation_0-auc:0.868957	validation_1-auc:0.83423
[42]	validation_0-auc:0.8702	validation_1-auc:0.835477
[43]	validation_0-auc:0.870314	validation_1-auc:0.835114
[44]	validation_0-auc:0.871716	validation_1-auc:0.836462
[45]	validation_0-auc:0.871663	validation_1-auc:0.835655
[46]	validation_0-auc:0.87289	validation_1-auc:0.836004
[47]	validation_0-auc:0.873749	validation_1-auc:0.836711
[48]	validation_0-auc:0.873994	validation_1-auc:0.835913
[49]	validation_0-auc:0.874252	validation_1-auc:0.836036
[50]	validation_0-auc:0.874346	validation_1-auc:0.835422
[51]	validation_0-auc:0.875219	validation_1-auc:0.835616
[52]	validation_0-auc:0.875905	validation_1-auc:0.836612
[53]	validation_0-auc:0.87616	validation_1-auc:0.836856
[54]	validation_0-auc:0.876668	validation_1-auc:0.837305
[55]	validation_0-auc:0.877203	validation_1-auc:0.837424
[56]	validation_0-auc:0.877871	validation_1-auc:0.837733
[57]	validation_0-auc:0.878483	validation_1-auc:0.838024
[58]	validation_0-auc:0.878805	validation_1-auc:0.837882
[59]	validation_0-auc:0.878856	validation_1-auc:0.838006
[60]	validation_0-auc:0.87908	validation_1-auc:0.838053
[61]	validation_0-auc:0.879399	validation_1-auc:0.838226
Stopping. Best iteration:
[31]	validation_0-auc:0.863184	validation_1-auc:0.839024

[0]	validation_0-auc:0.721794	validation_1-auc:0.729972
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.816181	validation_1-auc:0.815593
[2]	validation_0-auc:0.810598	validation_1-auc:0.812182
[3]	validation_0-auc:0.824917	validation_1-auc:0.824015
[4]	validation_0-auc:0.834639	validation_1-auc:0.829669
[5]	validation_0-auc:0.832167	validation_1-auc:0.829229
[6]	validation_0-auc:0.831205	validation_1-auc:0.828053
[7]	validation_0-auc:0.837774	validation_1-auc:0.832927
[8]	validation_0-auc:0.841743	validation_1-auc:0.835199
[9]	validation_0-auc:0.842553	validation_1-auc:0.834179
[10]	validation_0-auc:0.84541	validation_1-auc:0.835147
[11]	validation_0-auc:0.847807	validation_1-auc:0.835784
[12]	validation_0-auc:0.850016	validation_1-auc:0.836682
[13]	validation_0-auc:0.850301	validation_1-auc:0.835513
[14]	validation_0-auc:0.849382	validation_1-auc:0.833526
[15]	validation_0-auc:0.851464	validation_1-auc:0.834944
[16]	validation_0-auc:0.85302	validation_1-auc:0.83602
[17]	validation_0-auc:0.854222	validation_1-auc:0.836695
[18]	validation_0-auc:0.855732	validation_1-auc:0.838239
[19]	validation_0-auc:0.854741	validation_1-auc:0.837167
[20]	validation_0-auc:0.8566	validation_1-auc:0.838265
[21]	validation_0-auc:0.85613	validation_1-auc:0.837162
[22]	validation_0-auc:0.855438	validation_1-auc:0.836908
[23]	validation_0-auc:0.857481	validation_1-auc:0.838229
[24]	validation_0-auc:0.858208	validation_1-auc:0.839009
[25]	validation_0-auc:0.858366	validation_1-auc:0.838833
[26]	validation_0-auc:0.858753	validation_1-auc:0.837925
[27]	validation_0-auc:0.860394	validation_1-auc:0.839149
[28]	validation_0-auc:0.862688	validation_1-auc:0.839698
[29]	validation_0-auc:0.862355	validation_1-auc:0.840014
[30]	validation_0-auc:0.863569	validation_1-auc:0.840711
[31]	validation_0-auc:0.864699	validation_1-auc:0.841399
[32]	validation_0-auc:0.865096	validation_1-auc:0.840424
[33]	validation_0-auc:0.865341	validation_1-auc:0.839835
[34]	validation_0-auc:0.865459	validation_1-auc:0.839838
[35]	validation_0-auc:0.867656	validation_1-auc:0.840522
[36]	validation_0-auc:0.869286	validation_1-auc:0.839804
[37]	validation_0-auc:0.869651	validation_1-auc:0.839773
[38]	validation_0-auc:0.869688	validation_1-auc:0.839816
[39]	validation_0-auc:0.869731	validation_1-auc:0.839632
[40]	validation_0-auc:0.870363	validation_1-auc:0.839722
[41]	validation_0-auc:0.870685	validation_1-auc:0.839221
[42]	validation_0-auc:0.87202	validation_1-auc:0.840292
[43]	validation_0-auc:0.872136	validation_1-auc:0.83994
[44]	validation_0-auc:0.873539	validation_1-auc:0.84048
[45]	validation_0-auc:0.873524	validation_1-auc:0.840246
[46]	validation_0-auc:0.874717	validation_1-auc:0.840206
[47]	validation_0-auc:0.875518	validation_1-auc:0.840808
[48]	validation_0-auc:0.875837	validation_1-auc:0.840365
[49]	validation_0-auc:0.876385	validation_1-auc:0.840312
[50]	validation_0-auc:0.876694	validation_1-auc:0.840388
[51]	validation_0-auc:0.877755	validation_1-auc:0.840863
[52]	validation_0-auc:0.878419	validation_1-auc:0.841462
[53]	validation_0-auc:0.878754	validation_1-auc:0.841966
[54]	validation_0-auc:0.879199	validation_1-auc:0.842321
[55]	validation_0-auc:0.87937	validation_1-auc:0.842262
[56]	validation_0-auc:0.879922	validation_1-auc:0.842194
[57]	validation_0-auc:0.880332	validation_1-auc:0.842589
[58]	validation_0-auc:0.880693	validation_1-auc:0.842193
[59]	validation_0-auc:0.880801	validation_1-auc:0.842166
[60]	validation_0-auc:0.881292	validation_1-auc:0.842486
[61]	validation_0-auc:0.881506	validation_1-auc:0.842324
[62]	validation_0-auc:0.881644	validation_1-auc:0.842545
[63]	validation_0-auc:0.882057	validation_1-auc:0.842886
[64]	validation_0-auc:0.882231	validation_1-auc:0.843051
[65]	validation_0-auc:0.882333	validation_1-auc:0.843298
[66]	validation_0-auc:0.882522	validation_1-auc:0.843285
[67]	validation_0-auc:0.882853	validation_1-auc:0.843175
[68]	validation_0-auc:0.883077	validation_1-auc:0.842843
[69]	validation_0-auc:0.883102	validation_1-auc:0.842817
[70]	validation_0-auc:0.883244	validation_1-auc:0.842759
[71]	validation_0-auc:0.883563	validation_1-auc:0.842654
[72]	validation_0-auc:0.88363	validation_1-auc:0.842766
[73]	validation_0-auc:0.883787	validation_1-auc:0.842715
[74]	validation_0-auc:0.883861	validation_1-auc:0.842653
[75]	validation_0-auc:0.884056	validation_1-auc:0.842675
[76]	validation_0-auc:0.884047	validation_1-auc:0.842791
[77]	validation_0-auc:0.884179	validation_1-auc:0.84294
[78]	validation_0-auc:0.884755	validation_1-auc:0.842701
[79]	validation_0-auc:0.885294	validation_1-auc:0.842159
[80]	validation_0-auc:0.885398	validation_1-auc:0.842174
[81]	validation_0-auc:0.885486	validation_1-auc:0.842058
[82]	validation_0-auc:0.885613	validation_1-auc:0.841956
[83]	validation_0-auc:0.88573	validation_1-auc:0.841794
[84]	validation_0-auc:0.885793	validation_1-auc:0.841666
[85]	validation_0-auc:0.885933	validation_1-auc:0.841707
[86]	validation_0-auc:0.886325	validation_1-auc:0.841527
[87]	validation_0-auc:0.886641	validation_1-auc:0.841514
[88]	validation_0-auc:0.886843	validation_1-auc:0.841313
[89]	validation_0-auc:0.886922	validation_1-auc:0.841269
[90]	validation_0-auc:0.88708	validation_1-auc:0.841121
[91]	validation_0-auc:0.887483	validation_1-auc:0.841168
[92]	validation_0-auc:0.887526	validation_1-auc:0.841218
[93]	validation_0-auc:0.887624	validation_1-auc:0.841148
[94]	validation_0-auc:0.887677	validation_1-auc:0.841117
[95]	validation_0-auc:0.887879	validation_1-auc:0.841299
Stopping. Best iteration:
[65]	validation_0-auc:0.882333	validation_1-auc:0.843298

[0]	validation_0-auc:0.740963	validation_1-auc:0.745305
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.82294	validation_1-auc:0.821542
[2]	validation_0-auc:0.813813	validation_1-auc:0.809933
[3]	validation_0-auc:0.827473	validation_1-auc:0.822227
[4]	validation_0-auc:0.832393	validation_1-auc:0.826685
[5]	validation_0-auc:0.831888	validation_1-auc:0.822684
[6]	validation_0-auc:0.831945	validation_1-auc:0.821011
[7]	validation_0-auc:0.835043	validation_1-auc:0.824823
[8]	validation_0-auc:0.839917	validation_1-auc:0.82833
[9]	validation_0-auc:0.839675	validation_1-auc:0.827635
[10]	validation_0-auc:0.843606	validation_1-auc:0.829718
[11]	validation_0-auc:0.846078	validation_1-auc:0.833888
[12]	validation_0-auc:0.848075	validation_1-auc:0.834836
[13]	validation_0-auc:0.849433	validation_1-auc:0.833687
[14]	validation_0-auc:0.849192	validation_1-auc:0.83292
[15]	validation_0-auc:0.850493	validation_1-auc:0.835547
[16]	validation_0-auc:0.851873	validation_1-auc:0.836237
[17]	validation_0-auc:0.853231	validation_1-auc:0.837104
[18]	validation_0-auc:0.855444	validation_1-auc:0.837909
[19]	validation_0-auc:0.855014	validation_1-auc:0.837873
[20]	validation_0-auc:0.855766	validation_1-auc:0.837931
[21]	validation_0-auc:0.856186	validation_1-auc:0.837406
[22]	validation_0-auc:0.855717	validation_1-auc:0.836724
[23]	validation_0-auc:0.857644	validation_1-auc:0.837199
[24]	validation_0-auc:0.858666	validation_1-auc:0.838574
[25]	validation_0-auc:0.858893	validation_1-auc:0.837752
[26]	validation_0-auc:0.859081	validation_1-auc:0.837562
[27]	validation_0-auc:0.85988	validation_1-auc:0.839098
[28]	validation_0-auc:0.861397	validation_1-auc:0.839095
[29]	validation_0-auc:0.862234	validation_1-auc:0.8387
[30]	validation_0-auc:0.863926	validation_1-auc:0.839462
[31]	validation_0-auc:0.865878	validation_1-auc:0.84079
[32]	validation_0-auc:0.865936	validation_1-auc:0.839527
[33]	validation_0-auc:0.866032	validation_1-auc:0.839402
[34]	validation_0-auc:0.866021	validation_1-auc:0.838537
[35]	validation_0-auc:0.867978	validation_1-auc:0.839361
[36]	validation_0-auc:0.869778	validation_1-auc:0.8401
[37]	validation_0-auc:0.870014	validation_1-auc:0.839949
[38]	validation_0-auc:0.870137	validation_1-auc:0.839923
[39]	validation_0-auc:0.870045	validation_1-auc:0.839839
[40]	validation_0-auc:0.870197	validation_1-auc:0.839209
[41]	validation_0-auc:0.870183	validation_1-auc:0.83929
[42]	validation_0-auc:0.871398	validation_1-auc:0.840601
[43]	validation_0-auc:0.871459	validation_1-auc:0.840431
[44]	validation_0-auc:0.872657	validation_1-auc:0.840927
[45]	validation_0-auc:0.872808	validation_1-auc:0.840368
[46]	validation_0-auc:0.873773	validation_1-auc:0.841472
[47]	validation_0-auc:0.874733	validation_1-auc:0.841848
[48]	validation_0-auc:0.875131	validation_1-auc:0.841471
[49]	validation_0-auc:0.875527	validation_1-auc:0.84174
[50]	validation_0-auc:0.875681	validation_1-auc:0.841367
[51]	validation_0-auc:0.87658	validation_1-auc:0.841695
[52]	validation_0-auc:0.877447	validation_1-auc:0.842545
[53]	validation_0-auc:0.877759	validation_1-auc:0.843183
[54]	validation_0-auc:0.878152	validation_1-auc:0.843378
[55]	validation_0-auc:0.878548	validation_1-auc:0.843335
[56]	validation_0-auc:0.879247	validation_1-auc:0.843333
[57]	validation_0-auc:0.87958	validation_1-auc:0.843544
[58]	validation_0-auc:0.879851	validation_1-auc:0.843368
[59]	validation_0-auc:0.87993	validation_1-auc:0.843488
[60]	validation_0-auc:0.88037	validation_1-auc:0.843901
[61]	validation_0-auc:0.880598	validation_1-auc:0.844241
[62]	validation_0-auc:0.880888	validation_1-auc:0.844144
[63]	validation_0-auc:0.881245	validation_1-auc:0.843786
[64]	validation_0-auc:0.881447	validation_1-auc:0.843637
[65]	validation_0-auc:0.881678	validation_1-auc:0.843438
[66]	validation_0-auc:0.881755	validation_1-auc:0.843422
[67]	validation_0-auc:0.881986	validation_1-auc:0.843104
[68]	validation_0-auc:0.882323	validation_1-auc:0.843173
[69]	validation_0-auc:0.882661	validation_1-auc:0.843359
[70]	validation_0-auc:0.882962	validation_1-auc:0.843389
[71]	validation_0-auc:0.883189	validation_1-auc:0.843313
[72]	validation_0-auc:0.883264	validation_1-auc:0.843345
[73]	validation_0-auc:0.883449	validation_1-auc:0.843045
[74]	validation_0-auc:0.883673	validation_1-auc:0.843211
[75]	validation_0-auc:0.884143	validation_1-auc:0.843119
[76]	validation_0-auc:0.884333	validation_1-auc:0.8429
[77]	validation_0-auc:0.884471	validation_1-auc:0.843065
[78]	validation_0-auc:0.884589	validation_1-auc:0.843159
[79]	validation_0-auc:0.884864	validation_1-auc:0.843065
[80]	validation_0-auc:0.884904	validation_1-auc:0.842997
[81]	validation_0-auc:0.884936	validation_1-auc:0.842992
[82]	validation_0-auc:0.88509	validation_1-auc:0.843019
[83]	validation_0-auc:0.885605	validation_1-auc:0.842872
[84]	validation_0-auc:0.885867	validation_1-auc:0.84273
[85]	validation_0-auc:0.886141	validation_1-auc:0.842483
[86]	validation_0-auc:0.886197	validation_1-auc:0.842474
[87]	validation_0-auc:0.886314	validation_1-auc:0.842511
[88]	validation_0-auc:0.886444	validation_1-auc:0.842567
[89]	validation_0-auc:0.8868	validation_1-auc:0.842416
[90]	validation_0-auc:0.887258	validation_1-auc:0.84227
[91]	validation_0-auc:0.887801	validation_1-auc:0.842175
Stopping. Best iteration:
[61]	validation_0-auc:0.880598	validation_1-auc:0.844241

[0]	validation_0-auc:0.806564	validation_1-auc:0.807879
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.813222	validation_1-auc:0.814069
[2]	validation_0-auc:0.824347	validation_1-auc:0.81954
[3]	validation_0-auc:0.823013	validation_1-auc:0.817794
[4]	validation_0-auc:0.825004	validation_1-auc:0.820851
[5]	validation_0-auc:0.827322	validation_1-auc:0.824115
[6]	validation_0-auc:0.828594	validation_1-auc:0.824284
[7]	validation_0-auc:0.830032	validation_1-auc:0.824391
[8]	validation_0-auc:0.830134	validation_1-auc:0.823386
[9]	validation_0-auc:0.831487	validation_1-auc:0.82413
[10]	validation_0-auc:0.832208	validation_1-auc:0.824604
[11]	validation_0-auc:0.832751	validation_1-auc:0.825096
[12]	validation_0-auc:0.833429	validation_1-auc:0.825748
[13]	validation_0-auc:0.835708	validation_1-auc:0.829196
[14]	validation_0-auc:0.837779	validation_1-auc:0.83136
[15]	validation_0-auc:0.83897	validation_1-auc:0.831932
[16]	validation_0-auc:0.839486	validation_1-auc:0.832228
[17]	validation_0-auc:0.841367	validation_1-auc:0.833007
[18]	validation_0-auc:0.842174	validation_1-auc:0.833301
[19]	validation_0-auc:0.842695	validation_1-auc:0.834007
[20]	validation_0-auc:0.843936	validation_1-auc:0.834731
[21]	validation_0-auc:0.844851	validation_1-auc:0.835152
[22]	validation_0-auc:0.845958	validation_1-auc:0.836157
[23]	validation_0-auc:0.846706	validation_1-auc:0.837361
[24]	validation_0-auc:0.847273	validation_1-auc:0.838051
[25]	validation_0-auc:0.848304	validation_1-auc:0.838603
[26]	validation_0-auc:0.849067	validation_1-auc:0.838547
[27]	validation_0-auc:0.849303	validation_1-auc:0.838102
[28]	validation_0-auc:0.849706	validation_1-auc:0.838238
[29]	validation_0-auc:0.85139	validation_1-auc:0.83903
[30]	validation_0-auc:0.851681	validation_1-auc:0.839733
[31]	validation_0-auc:0.851898	validation_1-auc:0.839348
[32]	validation_0-auc:0.852313	validation_1-auc:0.839544
[33]	validation_0-auc:0.853202	validation_1-auc:0.839625
[34]	validation_0-auc:0.85374	validation_1-auc:0.839621
[35]	validation_0-auc:0.854461	validation_1-auc:0.839915
[36]	validation_0-auc:0.855122	validation_1-auc:0.839481
[37]	validation_0-auc:0.855818	validation_1-auc:0.83909
[38]	validation_0-auc:0.856423	validation_1-auc:0.839172
[39]	validation_0-auc:0.857532	validation_1-auc:0.839411
[40]	validation_0-auc:0.85783	validation_1-auc:0.839246
[41]	validation_0-auc:0.858498	validation_1-auc:0.839156
[42]	validation_0-auc:0.858992	validation_1-auc:0.839238
[43]	validation_0-auc:0.859655	validation_1-auc:0.838496
[44]	validation_0-auc:0.860197	validation_1-auc:0.838358
[45]	validation_0-auc:0.860625	validation_1-auc:0.839082
[46]	validation_0-auc:0.860953	validation_1-auc:0.839125
[47]	validation_0-auc:0.861608	validation_1-auc:0.838995
[48]	validation_0-auc:0.862085	validation_1-auc:0.839059
[49]	validation_0-auc:0.862354	validation_1-auc:0.839387
[50]	validation_0-auc:0.862812	validation_1-auc:0.839298
[51]	validation_0-auc:0.863372	validation_1-auc:0.839127
[52]	validation_0-auc:0.864029	validation_1-auc:0.839097
[53]	validation_0-auc:0.864379	validation_1-auc:0.839118
[54]	validation_0-auc:0.864775	validation_1-auc:0.838848
[55]	validation_0-auc:0.86518	validation_1-auc:0.838897
[56]	validation_0-auc:0.865428	validation_1-auc:0.838671
[57]	validation_0-auc:0.865679	validation_1-auc:0.838451
[58]	validation_0-auc:0.866057	validation_1-auc:0.838382
[59]	validation_0-auc:0.866205	validation_1-auc:0.838363
[60]	validation_0-auc:0.866485	validation_1-auc:0.83804
[61]	validation_0-auc:0.866681	validation_1-auc:0.837604
[62]	validation_0-auc:0.867	validation_1-auc:0.837733
[63]	validation_0-auc:0.867486	validation_1-auc:0.837969
[64]	validation_0-auc:0.867702	validation_1-auc:0.838082
[65]	validation_0-auc:0.868375	validation_1-auc:0.837616
Stopping. Best iteration:
[35]	validation_0-auc:0.854461	validation_1-auc:0.839915

[0]	validation_0-auc:0.808752	validation_1-auc:0.799538
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.814155	validation_1-auc:0.808631
[2]	validation_0-auc:0.822097	validation_1-auc:0.818521
[3]	validation_0-auc:0.824997	validation_1-auc:0.821016
[4]	validation_0-auc:0.82596	validation_1-auc:0.822133
[5]	validation_0-auc:0.828318	validation_1-auc:0.821871
[6]	validation_0-auc:0.830595	validation_1-auc:0.821864
[7]	validation_0-auc:0.831276	validation_1-auc:0.82227
[8]	validation_0-auc:0.832729	validation_1-auc:0.823541
[9]	validation_0-auc:0.834143	validation_1-auc:0.824047
[10]	validation_0-auc:0.835162	validation_1-auc:0.825246
[11]	validation_0-auc:0.836768	validation_1-auc:0.827402
[12]	validation_0-auc:0.837065	validation_1-auc:0.82759
[13]	validation_0-auc:0.838876	validation_1-auc:0.830193
[14]	validation_0-auc:0.84012	validation_1-auc:0.830561
[15]	validation_0-auc:0.841703	validation_1-auc:0.832011
[16]	validation_0-auc:0.842706	validation_1-auc:0.833235
[17]	validation_0-auc:0.84356	validation_1-auc:0.833103
[18]	validation_0-auc:0.844345	validation_1-auc:0.833676
[19]	validation_0-auc:0.844447	validation_1-auc:0.835896
[20]	validation_0-auc:0.845384	validation_1-auc:0.836075
[21]	validation_0-auc:0.845617	validation_1-auc:0.836584
[22]	validation_0-auc:0.846267	validation_1-auc:0.836907
[23]	validation_0-auc:0.846896	validation_1-auc:0.837555
[24]	validation_0-auc:0.847501	validation_1-auc:0.838138
[25]	validation_0-auc:0.849235	validation_1-auc:0.839048
[26]	validation_0-auc:0.850265	validation_1-auc:0.839043
[27]	validation_0-auc:0.850734	validation_1-auc:0.838901
[28]	validation_0-auc:0.851632	validation_1-auc:0.838865
[29]	validation_0-auc:0.852309	validation_1-auc:0.839417
[30]	validation_0-auc:0.852665	validation_1-auc:0.839633
[31]	validation_0-auc:0.853303	validation_1-auc:0.840026
[32]	validation_0-auc:0.854133	validation_1-auc:0.839994
[33]	validation_0-auc:0.85497	validation_1-auc:0.839934
[34]	validation_0-auc:0.856147	validation_1-auc:0.839845
[35]	validation_0-auc:0.857047	validation_1-auc:0.840351
[36]	validation_0-auc:0.857415	validation_1-auc:0.840809
[37]	validation_0-auc:0.857799	validation_1-auc:0.840804
[38]	validation_0-auc:0.858171	validation_1-auc:0.841041
[39]	validation_0-auc:0.858826	validation_1-auc:0.841016
[40]	validation_0-auc:0.859429	validation_1-auc:0.841528
[41]	validation_0-auc:0.860053	validation_1-auc:0.842104
[42]	validation_0-auc:0.860241	validation_1-auc:0.841967
[43]	validation_0-auc:0.860521	validation_1-auc:0.842079
[44]	validation_0-auc:0.860961	validation_1-auc:0.842283
[45]	validation_0-auc:0.861509	validation_1-auc:0.842462
[46]	validation_0-auc:0.861938	validation_1-auc:0.842485
[47]	validation_0-auc:0.862269	validation_1-auc:0.842715
[48]	validation_0-auc:0.862552	validation_1-auc:0.842509
[49]	validation_0-auc:0.862883	validation_1-auc:0.842596
[50]	validation_0-auc:0.863587	validation_1-auc:0.842594
[51]	validation_0-auc:0.863925	validation_1-auc:0.842499
[52]	validation_0-auc:0.864436	validation_1-auc:0.842449
[53]	validation_0-auc:0.864952	validation_1-auc:0.842423
[54]	validation_0-auc:0.865298	validation_1-auc:0.842617
[55]	validation_0-auc:0.865579	validation_1-auc:0.842512
[56]	validation_0-auc:0.865928	validation_1-auc:0.842242
[57]	validation_0-auc:0.866298	validation_1-auc:0.84222
[58]	validation_0-auc:0.866689	validation_1-auc:0.842318
[59]	validation_0-auc:0.866825	validation_1-auc:0.842231
[60]	validation_0-auc:0.867088	validation_1-auc:0.84245
[61]	validation_0-auc:0.867281	validation_1-auc:0.842443
[62]	validation_0-auc:0.867598	validation_1-auc:0.84245
[63]	validation_0-auc:0.868291	validation_1-auc:0.842671
[64]	validation_0-auc:0.86845	validation_1-auc:0.84272
[65]	validation_0-auc:0.868853	validation_1-auc:0.84273
[66]	validation_0-auc:0.869193	validation_1-auc:0.842628
[67]	validation_0-auc:0.869304	validation_1-auc:0.84268
[68]	validation_0-auc:0.869427	validation_1-auc:0.842534
[69]	validation_0-auc:0.869898	validation_1-auc:0.842645
[70]	validation_0-auc:0.870199	validation_1-auc:0.842776
[71]	validation_0-auc:0.870466	validation_1-auc:0.842644
[72]	validation_0-auc:0.870584	validation_1-auc:0.842963
[73]	validation_0-auc:0.870948	validation_1-auc:0.842821
[74]	validation_0-auc:0.871007	validation_1-auc:0.8429
[75]	validation_0-auc:0.871253	validation_1-auc:0.842937
[76]	validation_0-auc:0.871288	validation_1-auc:0.843017
[77]	validation_0-auc:0.871615	validation_1-auc:0.843032
[78]	validation_0-auc:0.871741	validation_1-auc:0.84307
[79]	validation_0-auc:0.871798	validation_1-auc:0.843173
[80]	validation_0-auc:0.87196	validation_1-auc:0.843207
[81]	validation_0-auc:0.87209	validation_1-auc:0.843221
[82]	validation_0-auc:0.872273	validation_1-auc:0.843041
[83]	validation_0-auc:0.872321	validation_1-auc:0.843289
[84]	validation_0-auc:0.872596	validation_1-auc:0.843436
[85]	validation_0-auc:0.87267	validation_1-auc:0.843399
[86]	validation_0-auc:0.873453	validation_1-auc:0.843272
[87]	validation_0-auc:0.87376	validation_1-auc:0.843304
[88]	validation_0-auc:0.873869	validation_1-auc:0.843283
[89]	validation_0-auc:0.873957	validation_1-auc:0.843209
[90]	validation_0-auc:0.874187	validation_1-auc:0.843207
[91]	validation_0-auc:0.874665	validation_1-auc:0.842896
[92]	validation_0-auc:0.874742	validation_1-auc:0.8429
[93]	validation_0-auc:0.874865	validation_1-auc:0.842835
[94]	validation_0-auc:0.875146	validation_1-auc:0.842858
[95]	validation_0-auc:0.87525	validation_1-auc:0.842866
[96]	validation_0-auc:0.875381	validation_1-auc:0.843033
[97]	validation_0-auc:0.875492	validation_1-auc:0.843001
[98]	validation_0-auc:0.875522	validation_1-auc:0.843134
[99]	validation_0-auc:0.87566	validation_1-auc:0.843094
[0]	validation_0-auc:0.82027	validation_1-auc:0.818497
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.824986	validation_1-auc:0.821693
[2]	validation_0-auc:0.827619	validation_1-auc:0.823498
[3]	validation_0-auc:0.829501	validation_1-auc:0.826488
[4]	validation_0-auc:0.830288	validation_1-auc:0.827163
[5]	validation_0-auc:0.830408	validation_1-auc:0.828035
[6]	validation_0-auc:0.831142	validation_1-auc:0.828415
[7]	validation_0-auc:0.831954	validation_1-auc:0.830204
[8]	validation_0-auc:0.832192	validation_1-auc:0.830511
[9]	validation_0-auc:0.833413	validation_1-auc:0.830476
[10]	validation_0-auc:0.834492	validation_1-auc:0.830577
[11]	validation_0-auc:0.835364	validation_1-auc:0.830758
[12]	validation_0-auc:0.838084	validation_1-auc:0.830693
[13]	validation_0-auc:0.840095	validation_1-auc:0.832873
[14]	validation_0-auc:0.842608	validation_1-auc:0.8343
[15]	validation_0-auc:0.843209	validation_1-auc:0.836268
[16]	validation_0-auc:0.84451	validation_1-auc:0.835857
[17]	validation_0-auc:0.844972	validation_1-auc:0.836283
[18]	validation_0-auc:0.845411	validation_1-auc:0.836243
[19]	validation_0-auc:0.845623	validation_1-auc:0.837443
[20]	validation_0-auc:0.846563	validation_1-auc:0.837309
[21]	validation_0-auc:0.846794	validation_1-auc:0.837453
[22]	validation_0-auc:0.847843	validation_1-auc:0.837781
[23]	validation_0-auc:0.848615	validation_1-auc:0.838383
[24]	validation_0-auc:0.849434	validation_1-auc:0.838103
[25]	validation_0-auc:0.85036	validation_1-auc:0.838932
[26]	validation_0-auc:0.850801	validation_1-auc:0.838703
[27]	validation_0-auc:0.850936	validation_1-auc:0.837935
[28]	validation_0-auc:0.851557	validation_1-auc:0.837842
[29]	validation_0-auc:0.852139	validation_1-auc:0.837859
[30]	validation_0-auc:0.852693	validation_1-auc:0.8387
[31]	validation_0-auc:0.853579	validation_1-auc:0.838874
[32]	validation_0-auc:0.853998	validation_1-auc:0.838908
[33]	validation_0-auc:0.85455	validation_1-auc:0.839699
[34]	validation_0-auc:0.855415	validation_1-auc:0.839791
[35]	validation_0-auc:0.856001	validation_1-auc:0.840646
[36]	validation_0-auc:0.856613	validation_1-auc:0.84121
[37]	validation_0-auc:0.857055	validation_1-auc:0.841172
[38]	validation_0-auc:0.858199	validation_1-auc:0.841545
[39]	validation_0-auc:0.858752	validation_1-auc:0.842195
[40]	validation_0-auc:0.859206	validation_1-auc:0.842244
[41]	validation_0-auc:0.859823	validation_1-auc:0.842735
[42]	validation_0-auc:0.860388	validation_1-auc:0.842844
[43]	validation_0-auc:0.860842	validation_1-auc:0.842556
[44]	validation_0-auc:0.861274	validation_1-auc:0.842262
[45]	validation_0-auc:0.861933	validation_1-auc:0.842308
[46]	validation_0-auc:0.862065	validation_1-auc:0.842429
[47]	validation_0-auc:0.862373	validation_1-auc:0.842475
[48]	validation_0-auc:0.862916	validation_1-auc:0.842572
[49]	validation_0-auc:0.863401	validation_1-auc:0.842409
[50]	validation_0-auc:0.863931	validation_1-auc:0.84275
[51]	validation_0-auc:0.864164	validation_1-auc:0.842496
[52]	validation_0-auc:0.864621	validation_1-auc:0.842664
[53]	validation_0-auc:0.864842	validation_1-auc:0.842896
[54]	validation_0-auc:0.865217	validation_1-auc:0.842746
[55]	validation_0-auc:0.865461	validation_1-auc:0.842567
[56]	validation_0-auc:0.86589	validation_1-auc:0.842841
[57]	validation_0-auc:0.866513	validation_1-auc:0.84258
[58]	validation_0-auc:0.866742	validation_1-auc:0.842548
[59]	validation_0-auc:0.866951	validation_1-auc:0.842733
[60]	validation_0-auc:0.867372	validation_1-auc:0.842844
[61]	validation_0-auc:0.867998	validation_1-auc:0.842998
[62]	validation_0-auc:0.86824	validation_1-auc:0.843009
[63]	validation_0-auc:0.868952	validation_1-auc:0.842834
[64]	validation_0-auc:0.86907	validation_1-auc:0.843022
[65]	validation_0-auc:0.869418	validation_1-auc:0.842873
[66]	validation_0-auc:0.8696	validation_1-auc:0.842844
[67]	validation_0-auc:0.869949	validation_1-auc:0.842907
[68]	validation_0-auc:0.870311	validation_1-auc:0.842901
[69]	validation_0-auc:0.870426	validation_1-auc:0.843182
[70]	validation_0-auc:0.870647	validation_1-auc:0.843211
[71]	validation_0-auc:0.870663	validation_1-auc:0.843213
[72]	validation_0-auc:0.870922	validation_1-auc:0.843157
[73]	validation_0-auc:0.871142	validation_1-auc:0.843224
[74]	validation_0-auc:0.87133	validation_1-auc:0.843503
[75]	validation_0-auc:0.871548	validation_1-auc:0.843697
[76]	validation_0-auc:0.871584	validation_1-auc:0.843795
[77]	validation_0-auc:0.871826	validation_1-auc:0.843774
[78]	validation_0-auc:0.872103	validation_1-auc:0.843831
[79]	validation_0-auc:0.872294	validation_1-auc:0.843708
[80]	validation_0-auc:0.872379	validation_1-auc:0.843848
[81]	validation_0-auc:0.872739	validation_1-auc:0.843906
[82]	validation_0-auc:0.872958	validation_1-auc:0.843736
[83]	validation_0-auc:0.87317	validation_1-auc:0.843793
[84]	validation_0-auc:0.873288	validation_1-auc:0.843735
[85]	validation_0-auc:0.873385	validation_1-auc:0.843778
[86]	validation_0-auc:0.873498	validation_1-auc:0.843736
[87]	validation_0-auc:0.873584	validation_1-auc:0.843735
[88]	validation_0-auc:0.874257	validation_1-auc:0.843578
[89]	validation_0-auc:0.874316	validation_1-auc:0.843551
[90]	validation_0-auc:0.874503	validation_1-auc:0.843643
[91]	validation_0-auc:0.874654	validation_1-auc:0.843474
[92]	validation_0-auc:0.874736	validation_1-auc:0.843406
[93]	validation_0-auc:0.875202	validation_1-auc:0.843326
[94]	validation_0-auc:0.875411	validation_1-auc:0.843486
[95]	validation_0-auc:0.875527	validation_1-auc:0.843492
[96]	validation_0-auc:0.87561	validation_1-auc:0.843417
[97]	validation_0-auc:0.87575	validation_1-auc:0.843612
[98]	validation_0-auc:0.875757	validation_1-auc:0.843605
[99]	validation_0-auc:0.875799	validation_1-auc:0.843622
[0]	validation_0-auc:0.807908	validation_1-auc:0.80725
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.812758	validation_1-auc:0.813847
[2]	validation_0-auc:0.823388	validation_1-auc:0.820791
[3]	validation_0-auc:0.825586	validation_1-auc:0.824392
[4]	validation_0-auc:0.826147	validation_1-auc:0.824779
[5]	validation_0-auc:0.827845	validation_1-auc:0.824904
[6]	validation_0-auc:0.829001	validation_1-auc:0.82554
[7]	validation_0-auc:0.829928	validation_1-auc:0.825921
[8]	validation_0-auc:0.830395	validation_1-auc:0.826045
[9]	validation_0-auc:0.831303	validation_1-auc:0.826876
[10]	validation_0-auc:0.832295	validation_1-auc:0.826935
[11]	validation_0-auc:0.834483	validation_1-auc:0.828591
[12]	validation_0-auc:0.834628	validation_1-auc:0.828348
[13]	validation_0-auc:0.837722	validation_1-auc:0.831902
[14]	validation_0-auc:0.838094	validation_1-auc:0.831937
[15]	validation_0-auc:0.838434	validation_1-auc:0.832287
[16]	validation_0-auc:0.838932	validation_1-auc:0.83321
[17]	validation_0-auc:0.840098	validation_1-auc:0.833629
[18]	validation_0-auc:0.840768	validation_1-auc:0.834075
[19]	validation_0-auc:0.841121	validation_1-auc:0.835054
[20]	validation_0-auc:0.841969	validation_1-auc:0.835206
[21]	validation_0-auc:0.842916	validation_1-auc:0.835963
[22]	validation_0-auc:0.843966	validation_1-auc:0.836312
[23]	validation_0-auc:0.844963	validation_1-auc:0.837719
[24]	validation_0-auc:0.845516	validation_1-auc:0.838331
[25]	validation_0-auc:0.846529	validation_1-auc:0.838645
[26]	validation_0-auc:0.846899	validation_1-auc:0.83828
[27]	validation_0-auc:0.847476	validation_1-auc:0.837964
[28]	validation_0-auc:0.84781	validation_1-auc:0.837906
[29]	validation_0-auc:0.849389	validation_1-auc:0.838712
[30]	validation_0-auc:0.849702	validation_1-auc:0.839396
[31]	validation_0-auc:0.849957	validation_1-auc:0.839502
[32]	validation_0-auc:0.850397	validation_1-auc:0.839573
[33]	validation_0-auc:0.851801	validation_1-auc:0.84008
[34]	validation_0-auc:0.852374	validation_1-auc:0.839765
[35]	validation_0-auc:0.853079	validation_1-auc:0.839998
[36]	validation_0-auc:0.853808	validation_1-auc:0.839875
[37]	validation_0-auc:0.854359	validation_1-auc:0.84006
[38]	validation_0-auc:0.854828	validation_1-auc:0.839893
[39]	validation_0-auc:0.855169	validation_1-auc:0.840194
[40]	validation_0-auc:0.855633	validation_1-auc:0.840032
[41]	validation_0-auc:0.856077	validation_1-auc:0.839898
[42]	validation_0-auc:0.856597	validation_1-auc:0.839734
[43]	validation_0-auc:0.857131	validation_1-auc:0.840028
[44]	validation_0-auc:0.857835	validation_1-auc:0.839468
[45]	validation_0-auc:0.858186	validation_1-auc:0.839669
[46]	validation_0-auc:0.858663	validation_1-auc:0.839325
[47]	validation_0-auc:0.858959	validation_1-auc:0.838964
[48]	validation_0-auc:0.85926	validation_1-auc:0.839184
[49]	validation_0-auc:0.859838	validation_1-auc:0.839273
[50]	validation_0-auc:0.860435	validation_1-auc:0.839397
[51]	validation_0-auc:0.860687	validation_1-auc:0.839238
[52]	validation_0-auc:0.861086	validation_1-auc:0.838816
[53]	validation_0-auc:0.8612	validation_1-auc:0.838816
[54]	validation_0-auc:0.861517	validation_1-auc:0.838789
[55]	validation_0-auc:0.861726	validation_1-auc:0.838785
[56]	validation_0-auc:0.861857	validation_1-auc:0.838909
[57]	validation_0-auc:0.86232	validation_1-auc:0.838797
[58]	validation_0-auc:0.862475	validation_1-auc:0.838947
[59]	validation_0-auc:0.862575	validation_1-auc:0.839266
[60]	validation_0-auc:0.862755	validation_1-auc:0.839195
[61]	validation_0-auc:0.86307	validation_1-auc:0.839449
[62]	validation_0-auc:0.863241	validation_1-auc:0.839404
[63]	validation_0-auc:0.863658	validation_1-auc:0.839428
[64]	validation_0-auc:0.86375	validation_1-auc:0.839621
[65]	validation_0-auc:0.86421	validation_1-auc:0.839633
[66]	validation_0-auc:0.86447	validation_1-auc:0.839787
[67]	validation_0-auc:0.86483	validation_1-auc:0.839489
[68]	validation_0-auc:0.864976	validation_1-auc:0.839477
[69]	validation_0-auc:0.865145	validation_1-auc:0.83945
Stopping. Best iteration:
[39]	validation_0-auc:0.855169	validation_1-auc:0.840194

[0]	validation_0-auc:0.811089	validation_1-auc:0.810522
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.816087	validation_1-auc:0.810073
[2]	validation_0-auc:0.822998	validation_1-auc:0.815151
[3]	validation_0-auc:0.826806	validation_1-auc:0.820533
[4]	validation_0-auc:0.828181	validation_1-auc:0.822161
[5]	validation_0-auc:0.830348	validation_1-auc:0.821808
[6]	validation_0-auc:0.831503	validation_1-auc:0.822127
[7]	validation_0-auc:0.833103	validation_1-auc:0.823879
[8]	validation_0-auc:0.833766	validation_1-auc:0.823991
[9]	validation_0-auc:0.835449	validation_1-auc:0.825018
[10]	validation_0-auc:0.837138	validation_1-auc:0.826524
[11]	validation_0-auc:0.838063	validation_1-auc:0.828248
[12]	validation_0-auc:0.838716	validation_1-auc:0.828212
[13]	validation_0-auc:0.840629	validation_1-auc:0.832417
[14]	validation_0-auc:0.841422	validation_1-auc:0.832226
[15]	validation_0-auc:0.84215	validation_1-auc:0.832481
[16]	validation_0-auc:0.842888	validation_1-auc:0.83351
[17]	validation_0-auc:0.843673	validation_1-auc:0.833692
[18]	validation_0-auc:0.844581	validation_1-auc:0.833959
[19]	validation_0-auc:0.845159	validation_1-auc:0.835978
[20]	validation_0-auc:0.846154	validation_1-auc:0.836474
[21]	validation_0-auc:0.846176	validation_1-auc:0.836993
[22]	validation_0-auc:0.846691	validation_1-auc:0.837588
[23]	validation_0-auc:0.847116	validation_1-auc:0.837619
[24]	validation_0-auc:0.847379	validation_1-auc:0.837757
[25]	validation_0-auc:0.84896	validation_1-auc:0.83865
[26]	validation_0-auc:0.849865	validation_1-auc:0.839331
[27]	validation_0-auc:0.850494	validation_1-auc:0.839233
[28]	validation_0-auc:0.850687	validation_1-auc:0.83874
[29]	validation_0-auc:0.851581	validation_1-auc:0.840013
[30]	validation_0-auc:0.851959	validation_1-auc:0.840506
[31]	validation_0-auc:0.852632	validation_1-auc:0.840666
[32]	validation_0-auc:0.853419	validation_1-auc:0.840939
[33]	validation_0-auc:0.854156	validation_1-auc:0.840998
[34]	validation_0-auc:0.854926	validation_1-auc:0.840819
[35]	validation_0-auc:0.855435	validation_1-auc:0.840371
[36]	validation_0-auc:0.856012	validation_1-auc:0.841026
[37]	validation_0-auc:0.856779	validation_1-auc:0.841145
[38]	validation_0-auc:0.857183	validation_1-auc:0.841309
[39]	validation_0-auc:0.857523	validation_1-auc:0.841563
[40]	validation_0-auc:0.857676	validation_1-auc:0.841515
[41]	validation_0-auc:0.858221	validation_1-auc:0.841764
[42]	validation_0-auc:0.858329	validation_1-auc:0.842147
[43]	validation_0-auc:0.858873	validation_1-auc:0.842088
[44]	validation_0-auc:0.859358	validation_1-auc:0.842362
[45]	validation_0-auc:0.859627	validation_1-auc:0.842605
[46]	validation_0-auc:0.860062	validation_1-auc:0.842442
[47]	validation_0-auc:0.860362	validation_1-auc:0.842616
[48]	validation_0-auc:0.860927	validation_1-auc:0.842697
[49]	validation_0-auc:0.861198	validation_1-auc:0.842581
[50]	validation_0-auc:0.861628	validation_1-auc:0.842449
[51]	validation_0-auc:0.861936	validation_1-auc:0.842502
[52]	validation_0-auc:0.862225	validation_1-auc:0.842589
[53]	validation_0-auc:0.86248	validation_1-auc:0.842689
[54]	validation_0-auc:0.862832	validation_1-auc:0.842739
[55]	validation_0-auc:0.862994	validation_1-auc:0.842743
[56]	validation_0-auc:0.863284	validation_1-auc:0.842597
[57]	validation_0-auc:0.863601	validation_1-auc:0.842704
[58]	validation_0-auc:0.863845	validation_1-auc:0.842245
[59]	validation_0-auc:0.864019	validation_1-auc:0.842346
[60]	validation_0-auc:0.864227	validation_1-auc:0.842519
[61]	validation_0-auc:0.864544	validation_1-auc:0.842433
[62]	validation_0-auc:0.864806	validation_1-auc:0.842801
[63]	validation_0-auc:0.865247	validation_1-auc:0.842848
[64]	validation_0-auc:0.865525	validation_1-auc:0.842828
[65]	validation_0-auc:0.865822	validation_1-auc:0.842751
[66]	validation_0-auc:0.866038	validation_1-auc:0.842655
[67]	validation_0-auc:0.866275	validation_1-auc:0.842602
[68]	validation_0-auc:0.866604	validation_1-auc:0.842502
[69]	validation_0-auc:0.866693	validation_1-auc:0.84252
[70]	validation_0-auc:0.866946	validation_1-auc:0.842566
[71]	validation_0-auc:0.86711	validation_1-auc:0.842733
[72]	validation_0-auc:0.867293	validation_1-auc:0.842745
[73]	validation_0-auc:0.867495	validation_1-auc:0.84276
[74]	validation_0-auc:0.867541	validation_1-auc:0.842733
[75]	validation_0-auc:0.867885	validation_1-auc:0.842855
[76]	validation_0-auc:0.868122	validation_1-auc:0.842662
[77]	validation_0-auc:0.868132	validation_1-auc:0.842601
[78]	validation_0-auc:0.868287	validation_1-auc:0.842473
[79]	validation_0-auc:0.868384	validation_1-auc:0.842588
[80]	validation_0-auc:0.868466	validation_1-auc:0.842567
[81]	validation_0-auc:0.868556	validation_1-auc:0.842523
[82]	validation_0-auc:0.868613	validation_1-auc:0.842564
[83]	validation_0-auc:0.868703	validation_1-auc:0.842619
[84]	validation_0-auc:0.868926	validation_1-auc:0.842642
[85]	validation_0-auc:0.86907	validation_1-auc:0.842434
[86]	validation_0-auc:0.869598	validation_1-auc:0.842438
[87]	validation_0-auc:0.869649	validation_1-auc:0.842542
[88]	validation_0-auc:0.869974	validation_1-auc:0.842645
[89]	validation_0-auc:0.870239	validation_1-auc:0.842725
[90]	validation_0-auc:0.870304	validation_1-auc:0.842976
[91]	validation_0-auc:0.870357	validation_1-auc:0.843049
[92]	validation_0-auc:0.870589	validation_1-auc:0.842932
[93]	validation_0-auc:0.870705	validation_1-auc:0.842894
[94]	validation_0-auc:0.870722	validation_1-auc:0.842895
[95]	validation_0-auc:0.870855	validation_1-auc:0.842915
[96]	validation_0-auc:0.87148	validation_1-auc:0.843074
[97]	validation_0-auc:0.871554	validation_1-auc:0.843143
[98]	validation_0-auc:0.871589	validation_1-auc:0.843225
[99]	validation_0-auc:0.871683	validation_1-auc:0.84326
[0]	validation_0-auc:0.81869	validation_1-auc:0.817015
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.824094	validation_1-auc:0.820241
[2]	validation_0-auc:0.826594	validation_1-auc:0.821724
[3]	validation_0-auc:0.829528	validation_1-auc:0.824428
[4]	validation_0-auc:0.829723	validation_1-auc:0.824865
[5]	validation_0-auc:0.831816	validation_1-auc:0.827197
[6]	validation_0-auc:0.834507	validation_1-auc:0.828953
[7]	validation_0-auc:0.834093	validation_1-auc:0.828848
[8]	validation_0-auc:0.834773	validation_1-auc:0.828773
[9]	validation_0-auc:0.836896	validation_1-auc:0.830533
[10]	validation_0-auc:0.8373	validation_1-auc:0.830395
[11]	validation_0-auc:0.838558	validation_1-auc:0.831468
[12]	validation_0-auc:0.839336	validation_1-auc:0.831619
[13]	validation_0-auc:0.841582	validation_1-auc:0.832997
[14]	validation_0-auc:0.84278	validation_1-auc:0.833628
[15]	validation_0-auc:0.843661	validation_1-auc:0.835948
[16]	validation_0-auc:0.844385	validation_1-auc:0.835966
[17]	validation_0-auc:0.844627	validation_1-auc:0.835877
[18]	validation_0-auc:0.845309	validation_1-auc:0.836331
[19]	validation_0-auc:0.845869	validation_1-auc:0.837529
[20]	validation_0-auc:0.846657	validation_1-auc:0.837465
[21]	validation_0-auc:0.846743	validation_1-auc:0.836762
[22]	validation_0-auc:0.848039	validation_1-auc:0.837713
[23]	validation_0-auc:0.848887	validation_1-auc:0.838072
[24]	validation_0-auc:0.849326	validation_1-auc:0.837901
[25]	validation_0-auc:0.849738	validation_1-auc:0.838432
[26]	validation_0-auc:0.84998	validation_1-auc:0.838271
[27]	validation_0-auc:0.85049	validation_1-auc:0.838129
[28]	validation_0-auc:0.850674	validation_1-auc:0.837812
[29]	validation_0-auc:0.851227	validation_1-auc:0.838234
[30]	validation_0-auc:0.851623	validation_1-auc:0.838185
[31]	validation_0-auc:0.852504	validation_1-auc:0.838433
[32]	validation_0-auc:0.853015	validation_1-auc:0.838103
[33]	validation_0-auc:0.8536	validation_1-auc:0.838398
[34]	validation_0-auc:0.854335	validation_1-auc:0.838896
[35]	validation_0-auc:0.854663	validation_1-auc:0.839009
[36]	validation_0-auc:0.855138	validation_1-auc:0.839035
[37]	validation_0-auc:0.855351	validation_1-auc:0.839193
[38]	validation_0-auc:0.856105	validation_1-auc:0.839668
[39]	validation_0-auc:0.856527	validation_1-auc:0.83972
[40]	validation_0-auc:0.857019	validation_1-auc:0.840403
[41]	validation_0-auc:0.8577	validation_1-auc:0.840506
[42]	validation_0-auc:0.85823	validation_1-auc:0.840863
[43]	validation_0-auc:0.858341	validation_1-auc:0.840702
[44]	validation_0-auc:0.858849	validation_1-auc:0.840818
[45]	validation_0-auc:0.859249	validation_1-auc:0.84054
[46]	validation_0-auc:0.859677	validation_1-auc:0.840957
[47]	validation_0-auc:0.860029	validation_1-auc:0.840932
[48]	validation_0-auc:0.860354	validation_1-auc:0.841196
[49]	validation_0-auc:0.861083	validation_1-auc:0.841041
[50]	validation_0-auc:0.86161	validation_1-auc:0.840806
[51]	validation_0-auc:0.861888	validation_1-auc:0.840807
[52]	validation_0-auc:0.862031	validation_1-auc:0.840712
[53]	validation_0-auc:0.862148	validation_1-auc:0.841085
[54]	validation_0-auc:0.862364	validation_1-auc:0.840974
[55]	validation_0-auc:0.862625	validation_1-auc:0.841115
[56]	validation_0-auc:0.86298	validation_1-auc:0.841224
[57]	validation_0-auc:0.86322	validation_1-auc:0.841244
[58]	validation_0-auc:0.86366	validation_1-auc:0.841556
[59]	validation_0-auc:0.863763	validation_1-auc:0.84171
[60]	validation_0-auc:0.863957	validation_1-auc:0.841699
[61]	validation_0-auc:0.864482	validation_1-auc:0.841928
[62]	validation_0-auc:0.864678	validation_1-auc:0.842071
[63]	validation_0-auc:0.865354	validation_1-auc:0.841938
[64]	validation_0-auc:0.865509	validation_1-auc:0.841847
[65]	validation_0-auc:0.865933	validation_1-auc:0.841702
[66]	validation_0-auc:0.866453	validation_1-auc:0.841829
[67]	validation_0-auc:0.866833	validation_1-auc:0.841797
[68]	validation_0-auc:0.866995	validation_1-auc:0.8418
[69]	validation_0-auc:0.867213	validation_1-auc:0.841732
[70]	validation_0-auc:0.86743	validation_1-auc:0.841808
[71]	validation_0-auc:0.867519	validation_1-auc:0.841862
[72]	validation_0-auc:0.867598	validation_1-auc:0.841909
[73]	validation_0-auc:0.867832	validation_1-auc:0.841787
[74]	validation_0-auc:0.868093	validation_1-auc:0.841807
[75]	validation_0-auc:0.868425	validation_1-auc:0.841962
[76]	validation_0-auc:0.868582	validation_1-auc:0.842073
[77]	validation_0-auc:0.868672	validation_1-auc:0.842049
[78]	validation_0-auc:0.868917	validation_1-auc:0.842261
[79]	validation_0-auc:0.86914	validation_1-auc:0.842081
[80]	validation_0-auc:0.869228	validation_1-auc:0.842027
[81]	validation_0-auc:0.869468	validation_1-auc:0.842075
[82]	validation_0-auc:0.869666	validation_1-auc:0.842218
[83]	validation_0-auc:0.869753	validation_1-auc:0.842223
[84]	validation_0-auc:0.870074	validation_1-auc:0.841883
[85]	validation_0-auc:0.870109	validation_1-auc:0.841967
[86]	validation_0-auc:0.87037	validation_1-auc:0.842077
[87]	validation_0-auc:0.870468	validation_1-auc:0.842073
[88]	validation_0-auc:0.870523	validation_1-auc:0.842093
[89]	validation_0-auc:0.870597	validation_1-auc:0.842088
[90]	validation_0-auc:0.870738	validation_1-auc:0.842109
[91]	validation_0-auc:0.870892	validation_1-auc:0.84204
[92]	validation_0-auc:0.870966	validation_1-auc:0.841996
[93]	validation_0-auc:0.871046	validation_1-auc:0.842032
[94]	validation_0-auc:0.871153	validation_1-auc:0.842115
[95]	validation_0-auc:0.871196	validation_1-auc:0.842151
[96]	validation_0-auc:0.87151	validation_1-auc:0.842321
[97]	validation_0-auc:0.871568	validation_1-auc:0.842296
[98]	validation_0-auc:0.871998	validation_1-auc:0.842273
[99]	validation_0-auc:0.872058	validation_1-auc:0.842221
[0]	validation_0-auc:0.817712	validation_1-auc:0.810588
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.823015	validation_1-auc:0.818968
[2]	validation_0-auc:0.828214	validation_1-auc:0.822304
[3]	validation_0-auc:0.833539	validation_1-auc:0.82819
[4]	validation_0-auc:0.834211	validation_1-auc:0.827305
[5]	validation_0-auc:0.835046	validation_1-auc:0.828758
[6]	validation_0-auc:0.835407	validation_1-auc:0.827876
[7]	validation_0-auc:0.83683	validation_1-auc:0.828116
[8]	validation_0-auc:0.837659	validation_1-auc:0.828302
[9]	validation_0-auc:0.839014	validation_1-auc:0.829387
[10]	validation_0-auc:0.840898	validation_1-auc:0.830616
[11]	validation_0-auc:0.844087	validation_1-auc:0.832978
[12]	validation_0-auc:0.844503	validation_1-auc:0.832845
[13]	validation_0-auc:0.847227	validation_1-auc:0.834672
[14]	validation_0-auc:0.848396	validation_1-auc:0.834519
[15]	validation_0-auc:0.849515	validation_1-auc:0.834663
[16]	validation_0-auc:0.850111	validation_1-auc:0.83459
[17]	validation_0-auc:0.850997	validation_1-auc:0.834885
[18]	validation_0-auc:0.85272	validation_1-auc:0.835186
[19]	validation_0-auc:0.854656	validation_1-auc:0.83683
[20]	validation_0-auc:0.856523	validation_1-auc:0.837953
[21]	validation_0-auc:0.857813	validation_1-auc:0.83859
[22]	validation_0-auc:0.859476	validation_1-auc:0.838282
[23]	validation_0-auc:0.860612	validation_1-auc:0.839272
[24]	validation_0-auc:0.861283	validation_1-auc:0.839902
[25]	validation_0-auc:0.862228	validation_1-auc:0.839589
[26]	validation_0-auc:0.863656	validation_1-auc:0.840069
[27]	validation_0-auc:0.86466	validation_1-auc:0.839876
[28]	validation_0-auc:0.865661	validation_1-auc:0.840048
[29]	validation_0-auc:0.866674	validation_1-auc:0.840362
[30]	validation_0-auc:0.867249	validation_1-auc:0.840364
[31]	validation_0-auc:0.868121	validation_1-auc:0.840257
[32]	validation_0-auc:0.869332	validation_1-auc:0.839613
[33]	validation_0-auc:0.870755	validation_1-auc:0.839598
[34]	validation_0-auc:0.871705	validation_1-auc:0.839193
[35]	validation_0-auc:0.872523	validation_1-auc:0.838919
[36]	validation_0-auc:0.873126	validation_1-auc:0.838771
[37]	validation_0-auc:0.874095	validation_1-auc:0.838751
[38]	validation_0-auc:0.874956	validation_1-auc:0.838446
[39]	validation_0-auc:0.876122	validation_1-auc:0.83853
[40]	validation_0-auc:0.877026	validation_1-auc:0.838389
[41]	validation_0-auc:0.877873	validation_1-auc:0.837915
[42]	validation_0-auc:0.878652	validation_1-auc:0.837942
[43]	validation_0-auc:0.87934	validation_1-auc:0.838043
[44]	validation_0-auc:0.880423	validation_1-auc:0.837712
[45]	validation_0-auc:0.880791	validation_1-auc:0.83756
[46]	validation_0-auc:0.881503	validation_1-auc:0.837544
[47]	validation_0-auc:0.881832	validation_1-auc:0.837269
[48]	validation_0-auc:0.882419	validation_1-auc:0.836991
[49]	validation_0-auc:0.88299	validation_1-auc:0.837038
[50]	validation_0-auc:0.883396	validation_1-auc:0.836611
[51]	validation_0-auc:0.883827	validation_1-auc:0.83643
[52]	validation_0-auc:0.884287	validation_1-auc:0.836238
[53]	validation_0-auc:0.88445	validation_1-auc:0.83625
[54]	validation_0-auc:0.884654	validation_1-auc:0.835958
[55]	validation_0-auc:0.885201	validation_1-auc:0.835594
[56]	validation_0-auc:0.885589	validation_1-auc:0.835714
[57]	validation_0-auc:0.886141	validation_1-auc:0.835716
[58]	validation_0-auc:0.886162	validation_1-auc:0.835799
[59]	validation_0-auc:0.886274	validation_1-auc:0.835712
[60]	validation_0-auc:0.886411	validation_1-auc:0.835559
Stopping. Best iteration:
[30]	validation_0-auc:0.867249	validation_1-auc:0.840364

[0]	validation_0-auc:0.814009	validation_1-auc:0.804403
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.821275	validation_1-auc:0.813196
[2]	validation_0-auc:0.827902	validation_1-auc:0.820319
[3]	validation_0-auc:0.833388	validation_1-auc:0.827078
[4]	validation_0-auc:0.83547	validation_1-auc:0.826685
[5]	validation_0-auc:0.840865	validation_1-auc:0.832065
[6]	validation_0-auc:0.843256	validation_1-auc:0.831047
[7]	validation_0-auc:0.844488	validation_1-auc:0.82997
[8]	validation_0-auc:0.846035	validation_1-auc:0.83064
[9]	validation_0-auc:0.847946	validation_1-auc:0.831142
[10]	validation_0-auc:0.848745	validation_1-auc:0.831627
[11]	validation_0-auc:0.850347	validation_1-auc:0.832598
[12]	validation_0-auc:0.851272	validation_1-auc:0.832519
[13]	validation_0-auc:0.853669	validation_1-auc:0.834865
[14]	validation_0-auc:0.855251	validation_1-auc:0.835849
[15]	validation_0-auc:0.856435	validation_1-auc:0.83605
[16]	validation_0-auc:0.857587	validation_1-auc:0.836177
[17]	validation_0-auc:0.859351	validation_1-auc:0.836231
[18]	validation_0-auc:0.860285	validation_1-auc:0.836331
[19]	validation_0-auc:0.860357	validation_1-auc:0.837599
[20]	validation_0-auc:0.862392	validation_1-auc:0.83764
[21]	validation_0-auc:0.862808	validation_1-auc:0.838513
[22]	validation_0-auc:0.863611	validation_1-auc:0.838655
[23]	validation_0-auc:0.864374	validation_1-auc:0.83937
[24]	validation_0-auc:0.864725	validation_1-auc:0.839486
[25]	validation_0-auc:0.86678	validation_1-auc:0.839619
[26]	validation_0-auc:0.867965	validation_1-auc:0.839874
[27]	validation_0-auc:0.868514	validation_1-auc:0.839624
[28]	validation_0-auc:0.86963	validation_1-auc:0.839225
[29]	validation_0-auc:0.870406	validation_1-auc:0.839483
[30]	validation_0-auc:0.870825	validation_1-auc:0.840008
[31]	validation_0-auc:0.871477	validation_1-auc:0.839807
[32]	validation_0-auc:0.872682	validation_1-auc:0.840147
[33]	validation_0-auc:0.873618	validation_1-auc:0.840186
[34]	validation_0-auc:0.874754	validation_1-auc:0.840607
[35]	validation_0-auc:0.876167	validation_1-auc:0.840615
[36]	validation_0-auc:0.876782	validation_1-auc:0.840408
[37]	validation_0-auc:0.878021	validation_1-auc:0.84085
[38]	validation_0-auc:0.878555	validation_1-auc:0.840715
[39]	validation_0-auc:0.879371	validation_1-auc:0.84093
[40]	validation_0-auc:0.880198	validation_1-auc:0.840802
[41]	validation_0-auc:0.880884	validation_1-auc:0.841331
[42]	validation_0-auc:0.881556	validation_1-auc:0.841448
[43]	validation_0-auc:0.882347	validation_1-auc:0.841311
[44]	validation_0-auc:0.8829	validation_1-auc:0.841572
[45]	validation_0-auc:0.884097	validation_1-auc:0.841457
[46]	validation_0-auc:0.884367	validation_1-auc:0.841169
[47]	validation_0-auc:0.884736	validation_1-auc:0.840852
[48]	validation_0-auc:0.885	validation_1-auc:0.841148
[49]	validation_0-auc:0.885356	validation_1-auc:0.841212
[50]	validation_0-auc:0.885925	validation_1-auc:0.841469
[51]	validation_0-auc:0.886219	validation_1-auc:0.841727
[52]	validation_0-auc:0.886435	validation_1-auc:0.841437
[53]	validation_0-auc:0.886731	validation_1-auc:0.841401
[54]	validation_0-auc:0.887004	validation_1-auc:0.840979
[55]	validation_0-auc:0.887395	validation_1-auc:0.841104
[56]	validation_0-auc:0.887635	validation_1-auc:0.841365
[57]	validation_0-auc:0.887682	validation_1-auc:0.841268
[58]	validation_0-auc:0.888069	validation_1-auc:0.841684
[59]	validation_0-auc:0.888322	validation_1-auc:0.841656
[60]	validation_0-auc:0.888595	validation_1-auc:0.841582
[61]	validation_0-auc:0.888861	validation_1-auc:0.841484
[62]	validation_0-auc:0.889109	validation_1-auc:0.841435
[63]	validation_0-auc:0.889426	validation_1-auc:0.841417
[64]	validation_0-auc:0.88975	validation_1-auc:0.841504
[65]	validation_0-auc:0.889841	validation_1-auc:0.841618
[66]	validation_0-auc:0.890394	validation_1-auc:0.841629
[67]	validation_0-auc:0.890968	validation_1-auc:0.841661
[68]	validation_0-auc:0.891024	validation_1-auc:0.841571
[69]	validation_0-auc:0.891202	validation_1-auc:0.841578
[70]	validation_0-auc:0.891389	validation_1-auc:0.841315
[71]	validation_0-auc:0.891616	validation_1-auc:0.841526
[72]	validation_0-auc:0.891833	validation_1-auc:0.841506
[73]	validation_0-auc:0.892109	validation_1-auc:0.841512
[74]	validation_0-auc:0.892198	validation_1-auc:0.841513
[75]	validation_0-auc:0.892731	validation_1-auc:0.84118
[76]	validation_0-auc:0.892854	validation_1-auc:0.841121
[77]	validation_0-auc:0.892957	validation_1-auc:0.841006
[78]	validation_0-auc:0.893036	validation_1-auc:0.841015
[79]	validation_0-auc:0.893313	validation_1-auc:0.841004
[80]	validation_0-auc:0.893484	validation_1-auc:0.840925
[81]	validation_0-auc:0.893829	validation_1-auc:0.840727
Stopping. Best iteration:
[51]	validation_0-auc:0.886219	validation_1-auc:0.841727

[0]	validation_0-auc:0.824399	validation_1-auc:0.819077
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.830053	validation_1-auc:0.823195
[2]	validation_0-auc:0.832218	validation_1-auc:0.823544
[3]	validation_0-auc:0.835388	validation_1-auc:0.825845
[4]	validation_0-auc:0.836287	validation_1-auc:0.82787
[5]	validation_0-auc:0.837967	validation_1-auc:0.829872
[6]	validation_0-auc:0.840351	validation_1-auc:0.831946
[7]	validation_0-auc:0.841831	validation_1-auc:0.832248
[8]	validation_0-auc:0.843349	validation_1-auc:0.831948
[9]	validation_0-auc:0.846394	validation_1-auc:0.83418
[10]	validation_0-auc:0.846883	validation_1-auc:0.833549
[11]	validation_0-auc:0.848243	validation_1-auc:0.83422
[12]	validation_0-auc:0.849983	validation_1-auc:0.835177
[13]	validation_0-auc:0.852181	validation_1-auc:0.835688
[14]	validation_0-auc:0.853333	validation_1-auc:0.835413
[15]	validation_0-auc:0.855205	validation_1-auc:0.836296
[16]	validation_0-auc:0.857186	validation_1-auc:0.836332
[17]	validation_0-auc:0.858454	validation_1-auc:0.836376
[18]	validation_0-auc:0.859578	validation_1-auc:0.836783
[19]	validation_0-auc:0.861036	validation_1-auc:0.837546
[20]	validation_0-auc:0.861756	validation_1-auc:0.837934
[21]	validation_0-auc:0.8623	validation_1-auc:0.837426
[22]	validation_0-auc:0.863827	validation_1-auc:0.837641
[23]	validation_0-auc:0.864539	validation_1-auc:0.837693
[24]	validation_0-auc:0.865551	validation_1-auc:0.838019
[25]	validation_0-auc:0.866718	validation_1-auc:0.838562
[26]	validation_0-auc:0.867754	validation_1-auc:0.83845
[27]	validation_0-auc:0.868879	validation_1-auc:0.838682
[28]	validation_0-auc:0.870252	validation_1-auc:0.838675
[29]	validation_0-auc:0.870943	validation_1-auc:0.83853
[30]	validation_0-auc:0.87176	validation_1-auc:0.838598
[31]	validation_0-auc:0.872932	validation_1-auc:0.838974
[32]	validation_0-auc:0.87413	validation_1-auc:0.838776
[33]	validation_0-auc:0.87467	validation_1-auc:0.838995
[34]	validation_0-auc:0.876336	validation_1-auc:0.839242
[35]	validation_0-auc:0.877356	validation_1-auc:0.839565
[36]	validation_0-auc:0.878342	validation_1-auc:0.839862
[37]	validation_0-auc:0.879657	validation_1-auc:0.839969
[38]	validation_0-auc:0.880426	validation_1-auc:0.840231
[39]	validation_0-auc:0.881596	validation_1-auc:0.840595
[40]	validation_0-auc:0.882042	validation_1-auc:0.841022
[41]	validation_0-auc:0.882703	validation_1-auc:0.841505
[42]	validation_0-auc:0.882965	validation_1-auc:0.84166
[43]	validation_0-auc:0.883453	validation_1-auc:0.841512
[44]	validation_0-auc:0.88406	validation_1-auc:0.841509
[45]	validation_0-auc:0.884335	validation_1-auc:0.842062
[46]	validation_0-auc:0.884537	validation_1-auc:0.842024
[47]	validation_0-auc:0.884992	validation_1-auc:0.841782
[48]	validation_0-auc:0.885285	validation_1-auc:0.841408
[49]	validation_0-auc:0.886128	validation_1-auc:0.84114
[50]	validation_0-auc:0.886855	validation_1-auc:0.841171
[51]	validation_0-auc:0.887289	validation_1-auc:0.841406
[52]	validation_0-auc:0.88768	validation_1-auc:0.841202
[53]	validation_0-auc:0.887873	validation_1-auc:0.841497
[54]	validation_0-auc:0.88824	validation_1-auc:0.841425
[55]	validation_0-auc:0.888471	validation_1-auc:0.841235
[56]	validation_0-auc:0.888995	validation_1-auc:0.841071
[57]	validation_0-auc:0.889387	validation_1-auc:0.840991
[58]	validation_0-auc:0.889699	validation_1-auc:0.841233
[59]	validation_0-auc:0.889794	validation_1-auc:0.841172
[60]	validation_0-auc:0.890006	validation_1-auc:0.841216
[61]	validation_0-auc:0.890274	validation_1-auc:0.840975
[62]	validation_0-auc:0.890593	validation_1-auc:0.84107
[63]	validation_0-auc:0.89141	validation_1-auc:0.841085
[64]	validation_0-auc:0.891682	validation_1-auc:0.841143
[65]	validation_0-auc:0.892278	validation_1-auc:0.841065
[66]	validation_0-auc:0.892727	validation_1-auc:0.840958
[67]	validation_0-auc:0.893137	validation_1-auc:0.840921
[68]	validation_0-auc:0.893388	validation_1-auc:0.840771
[69]	validation_0-auc:0.893529	validation_1-auc:0.84087
[70]	validation_0-auc:0.893802	validation_1-auc:0.840709
[71]	validation_0-auc:0.893855	validation_1-auc:0.840794
[72]	validation_0-auc:0.894019	validation_1-auc:0.840836
[73]	validation_0-auc:0.894373	validation_1-auc:0.841008
[74]	validation_0-auc:0.894542	validation_1-auc:0.840932
[75]	validation_0-auc:0.894724	validation_1-auc:0.840937
Stopping. Best iteration:
[45]	validation_0-auc:0.884335	validation_1-auc:0.842062

[0]	validation_0-auc:0.816109	validation_1-auc:0.811
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.819872	validation_1-auc:0.81779
[2]	validation_0-auc:0.824849	validation_1-auc:0.822903
[3]	validation_0-auc:0.830007	validation_1-auc:0.828519
[4]	validation_0-auc:0.832854	validation_1-auc:0.827557
[5]	validation_0-auc:0.834149	validation_1-auc:0.827368
[6]	validation_0-auc:0.834636	validation_1-auc:0.826976
[7]	validation_0-auc:0.837501	validation_1-auc:0.829633
[8]	validation_0-auc:0.838328	validation_1-auc:0.830027
[9]	validation_0-auc:0.838841	validation_1-auc:0.829949
[10]	validation_0-auc:0.840176	validation_1-auc:0.831158
[11]	validation_0-auc:0.842079	validation_1-auc:0.832887
[12]	validation_0-auc:0.843723	validation_1-auc:0.832917
[13]	validation_0-auc:0.846347	validation_1-auc:0.834399
[14]	validation_0-auc:0.846758	validation_1-auc:0.834084
[15]	validation_0-auc:0.848457	validation_1-auc:0.835137
[16]	validation_0-auc:0.849617	validation_1-auc:0.835877
[17]	validation_0-auc:0.850804	validation_1-auc:0.836028
[18]	validation_0-auc:0.852267	validation_1-auc:0.837113
[19]	validation_0-auc:0.854089	validation_1-auc:0.837728
[20]	validation_0-auc:0.855665	validation_1-auc:0.83781
[21]	validation_0-auc:0.857362	validation_1-auc:0.837673
[22]	validation_0-auc:0.858496	validation_1-auc:0.83732
[23]	validation_0-auc:0.859406	validation_1-auc:0.838683
[24]	validation_0-auc:0.859945	validation_1-auc:0.839756
[25]	validation_0-auc:0.86069	validation_1-auc:0.839867
[26]	validation_0-auc:0.861736	validation_1-auc:0.840104
[27]	validation_0-auc:0.862272	validation_1-auc:0.840015
[28]	validation_0-auc:0.863338	validation_1-auc:0.840285
[29]	validation_0-auc:0.864203	validation_1-auc:0.840305
[30]	validation_0-auc:0.86482	validation_1-auc:0.840508
[31]	validation_0-auc:0.865379	validation_1-auc:0.840721
[32]	validation_0-auc:0.866113	validation_1-auc:0.840763
[33]	validation_0-auc:0.866982	validation_1-auc:0.841607
[34]	validation_0-auc:0.867732	validation_1-auc:0.840969
[35]	validation_0-auc:0.86812	validation_1-auc:0.841285
[36]	validation_0-auc:0.86874	validation_1-auc:0.840923
[37]	validation_0-auc:0.869344	validation_1-auc:0.841037
[38]	validation_0-auc:0.869928	validation_1-auc:0.840759
[39]	validation_0-auc:0.870372	validation_1-auc:0.840408
[40]	validation_0-auc:0.870911	validation_1-auc:0.840092
[41]	validation_0-auc:0.871554	validation_1-auc:0.839695
[42]	validation_0-auc:0.872262	validation_1-auc:0.839703
[43]	validation_0-auc:0.872708	validation_1-auc:0.839395
[44]	validation_0-auc:0.873538	validation_1-auc:0.839025
[45]	validation_0-auc:0.873977	validation_1-auc:0.839155
[46]	validation_0-auc:0.874467	validation_1-auc:0.838886
[47]	validation_0-auc:0.874994	validation_1-auc:0.838864
[48]	validation_0-auc:0.875554	validation_1-auc:0.838282
[49]	validation_0-auc:0.876234	validation_1-auc:0.838466
[50]	validation_0-auc:0.876706	validation_1-auc:0.838328
[51]	validation_0-auc:0.877109	validation_1-auc:0.838213
[52]	validation_0-auc:0.877592	validation_1-auc:0.838165
[53]	validation_0-auc:0.877698	validation_1-auc:0.838241
[54]	validation_0-auc:0.878233	validation_1-auc:0.838471
[55]	validation_0-auc:0.878519	validation_1-auc:0.83838
[56]	validation_0-auc:0.878806	validation_1-auc:0.83865
[57]	validation_0-auc:0.878902	validation_1-auc:0.838288
[58]	validation_0-auc:0.878947	validation_1-auc:0.838054
[59]	validation_0-auc:0.878985	validation_1-auc:0.838261
[60]	validation_0-auc:0.879105	validation_1-auc:0.837968
[61]	validation_0-auc:0.879264	validation_1-auc:0.837762
[62]	validation_0-auc:0.879514	validation_1-auc:0.837838
[63]	validation_0-auc:0.87971	validation_1-auc:0.837783
Stopping. Best iteration:
[33]	validation_0-auc:0.866982	validation_1-auc:0.841607

[0]	validation_0-auc:0.814792	validation_1-auc:0.81277
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.820829	validation_1-auc:0.813089
[2]	validation_0-auc:0.827936	validation_1-auc:0.819769
[3]	validation_0-auc:0.833962	validation_1-auc:0.825464
[4]	validation_0-auc:0.836582	validation_1-auc:0.825799
[5]	validation_0-auc:0.836903	validation_1-auc:0.825238
[6]	validation_0-auc:0.838161	validation_1-auc:0.826533
[7]	validation_0-auc:0.839693	validation_1-auc:0.826822
[8]	validation_0-auc:0.841712	validation_1-auc:0.828277
[9]	validation_0-auc:0.845958	validation_1-auc:0.832116
[10]	validation_0-auc:0.846792	validation_1-auc:0.831954
[11]	validation_0-auc:0.848445	validation_1-auc:0.833573
[12]	validation_0-auc:0.849484	validation_1-auc:0.833751
[13]	validation_0-auc:0.852321	validation_1-auc:0.835946
[14]	validation_0-auc:0.854014	validation_1-auc:0.836002
[15]	validation_0-auc:0.855223	validation_1-auc:0.836295
[16]	validation_0-auc:0.857117	validation_1-auc:0.836664
[17]	validation_0-auc:0.858391	validation_1-auc:0.836238
[18]	validation_0-auc:0.859126	validation_1-auc:0.835928
[19]	validation_0-auc:0.8594	validation_1-auc:0.837799
[20]	validation_0-auc:0.860264	validation_1-auc:0.838177
[21]	validation_0-auc:0.860379	validation_1-auc:0.838336
[22]	validation_0-auc:0.861472	validation_1-auc:0.838809
[23]	validation_0-auc:0.862134	validation_1-auc:0.839298
[24]	validation_0-auc:0.862651	validation_1-auc:0.839612
[25]	validation_0-auc:0.864528	validation_1-auc:0.839835
[26]	validation_0-auc:0.86574	validation_1-auc:0.839808
[27]	validation_0-auc:0.866354	validation_1-auc:0.839503
[28]	validation_0-auc:0.867121	validation_1-auc:0.839406
[29]	validation_0-auc:0.867641	validation_1-auc:0.839913
[30]	validation_0-auc:0.868012	validation_1-auc:0.840032
[31]	validation_0-auc:0.868541	validation_1-auc:0.840255
[32]	validation_0-auc:0.869574	validation_1-auc:0.840143
[33]	validation_0-auc:0.870155	validation_1-auc:0.841059
[34]	validation_0-auc:0.870925	validation_1-auc:0.841149
[35]	validation_0-auc:0.871876	validation_1-auc:0.841183
[36]	validation_0-auc:0.872823	validation_1-auc:0.841001
[37]	validation_0-auc:0.874043	validation_1-auc:0.841675
[38]	validation_0-auc:0.874618	validation_1-auc:0.841155
[39]	validation_0-auc:0.875415	validation_1-auc:0.840771
[40]	validation_0-auc:0.875923	validation_1-auc:0.840773
[41]	validation_0-auc:0.876593	validation_1-auc:0.841043
[42]	validation_0-auc:0.877128	validation_1-auc:0.840944
[43]	validation_0-auc:0.877797	validation_1-auc:0.841351
[44]	validation_0-auc:0.878149	validation_1-auc:0.840944
[45]	validation_0-auc:0.878691	validation_1-auc:0.840678
[46]	validation_0-auc:0.879032	validation_1-auc:0.840438
[47]	validation_0-auc:0.879512	validation_1-auc:0.840368
[48]	validation_0-auc:0.879634	validation_1-auc:0.841143
[49]	validation_0-auc:0.879903	validation_1-auc:0.841131
[50]	validation_0-auc:0.880389	validation_1-auc:0.841786
[51]	validation_0-auc:0.880629	validation_1-auc:0.842091
[52]	validation_0-auc:0.880777	validation_1-auc:0.841881
[53]	validation_0-auc:0.880886	validation_1-auc:0.84184
[54]	validation_0-auc:0.881063	validation_1-auc:0.841748
[55]	validation_0-auc:0.881292	validation_1-auc:0.841751
[56]	validation_0-auc:0.881515	validation_1-auc:0.841349
[57]	validation_0-auc:0.881908	validation_1-auc:0.841686
[58]	validation_0-auc:0.88228	validation_1-auc:0.841461
[59]	validation_0-auc:0.882357	validation_1-auc:0.841579
[60]	validation_0-auc:0.882716	validation_1-auc:0.841512
[61]	validation_0-auc:0.882939	validation_1-auc:0.841415
[62]	validation_0-auc:0.883049	validation_1-auc:0.841426
[63]	validation_0-auc:0.883365	validation_1-auc:0.841612
[64]	validation_0-auc:0.883681	validation_1-auc:0.841852
[65]	validation_0-auc:0.884057	validation_1-auc:0.841847
[66]	validation_0-auc:0.884053	validation_1-auc:0.841909
[67]	validation_0-auc:0.88446	validation_1-auc:0.841985
[68]	validation_0-auc:0.884938	validation_1-auc:0.841768
[69]	validation_0-auc:0.885009	validation_1-auc:0.841656
[70]	validation_0-auc:0.885288	validation_1-auc:0.841626
[71]	validation_0-auc:0.885498	validation_1-auc:0.841288
[72]	validation_0-auc:0.885587	validation_1-auc:0.841334
[73]	validation_0-auc:0.885921	validation_1-auc:0.841217
[74]	validation_0-auc:0.886022	validation_1-auc:0.841253
[75]	validation_0-auc:0.886104	validation_1-auc:0.841179
[76]	validation_0-auc:0.886118	validation_1-auc:0.841086
[77]	validation_0-auc:0.886213	validation_1-auc:0.840992
[78]	validation_0-auc:0.886302	validation_1-auc:0.841043
[79]	validation_0-auc:0.8867	validation_1-auc:0.840975
[80]	validation_0-auc:0.886765	validation_1-auc:0.841085
[81]	validation_0-auc:0.88698	validation_1-auc:0.840836
Stopping. Best iteration:
[51]	validation_0-auc:0.880629	validation_1-auc:0.842091

[0]	validation_0-auc:0.822547	validation_1-auc:0.816922
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.828706	validation_1-auc:0.82116
[2]	validation_0-auc:0.831879	validation_1-auc:0.821933
[3]	validation_0-auc:0.834662	validation_1-auc:0.824465
[4]	validation_0-auc:0.835552	validation_1-auc:0.825234
[5]	validation_0-auc:0.839077	validation_1-auc:0.827428
[6]	validation_0-auc:0.840652	validation_1-auc:0.82851
[7]	validation_0-auc:0.84095	validation_1-auc:0.829562
[8]	validation_0-auc:0.842854	validation_1-auc:0.83
[9]	validation_0-auc:0.8449	validation_1-auc:0.832245
[10]	validation_0-auc:0.845603	validation_1-auc:0.831609
[11]	validation_0-auc:0.84681	validation_1-auc:0.832829
[12]	validation_0-auc:0.848605	validation_1-auc:0.832533
[13]	validation_0-auc:0.851942	validation_1-auc:0.83425
[14]	validation_0-auc:0.852806	validation_1-auc:0.834116
[15]	validation_0-auc:0.853447	validation_1-auc:0.835041
[16]	validation_0-auc:0.855529	validation_1-auc:0.83533
[17]	validation_0-auc:0.856689	validation_1-auc:0.83559
[18]	validation_0-auc:0.858302	validation_1-auc:0.836042
[19]	validation_0-auc:0.858807	validation_1-auc:0.837122
[20]	validation_0-auc:0.860238	validation_1-auc:0.837044
[21]	validation_0-auc:0.860958	validation_1-auc:0.838006
[22]	validation_0-auc:0.862181	validation_1-auc:0.837731
[23]	validation_0-auc:0.862619	validation_1-auc:0.837964
[24]	validation_0-auc:0.863608	validation_1-auc:0.83872
[25]	validation_0-auc:0.864562	validation_1-auc:0.838933
[26]	validation_0-auc:0.865559	validation_1-auc:0.838492
[27]	validation_0-auc:0.866754	validation_1-auc:0.838682
[28]	validation_0-auc:0.867742	validation_1-auc:0.838644
[29]	validation_0-auc:0.868271	validation_1-auc:0.838802
[30]	validation_0-auc:0.868739	validation_1-auc:0.839879
[31]	validation_0-auc:0.869424	validation_1-auc:0.839876
[32]	validation_0-auc:0.870024	validation_1-auc:0.839747
[33]	validation_0-auc:0.870427	validation_1-auc:0.839557
[34]	validation_0-auc:0.871614	validation_1-auc:0.839181
[35]	validation_0-auc:0.872415	validation_1-auc:0.839009
[36]	validation_0-auc:0.873075	validation_1-auc:0.839169
[37]	validation_0-auc:0.873698	validation_1-auc:0.838981
[38]	validation_0-auc:0.874339	validation_1-auc:0.839059
[39]	validation_0-auc:0.875347	validation_1-auc:0.839467
[40]	validation_0-auc:0.875856	validation_1-auc:0.840012
[41]	validation_0-auc:0.87597	validation_1-auc:0.840162
[42]	validation_0-auc:0.876346	validation_1-auc:0.840055
[43]	validation_0-auc:0.876644	validation_1-auc:0.840038
[44]	validation_0-auc:0.877169	validation_1-auc:0.840001
[45]	validation_0-auc:0.877424	validation_1-auc:0.840222
[46]	validation_0-auc:0.877981	validation_1-auc:0.840009
[47]	validation_0-auc:0.878263	validation_1-auc:0.839739
[48]	validation_0-auc:0.878718	validation_1-auc:0.839646
[49]	validation_0-auc:0.879236	validation_1-auc:0.839806
[50]	validation_0-auc:0.879659	validation_1-auc:0.839612
[51]	validation_0-auc:0.879952	validation_1-auc:0.839761
[52]	validation_0-auc:0.880243	validation_1-auc:0.840021
[53]	validation_0-auc:0.880541	validation_1-auc:0.839922
[54]	validation_0-auc:0.880797	validation_1-auc:0.839573
[55]	validation_0-auc:0.881066	validation_1-auc:0.839662
[56]	validation_0-auc:0.881392	validation_1-auc:0.839575
[57]	validation_0-auc:0.88157	validation_1-auc:0.83976
[58]	validation_0-auc:0.881964	validation_1-auc:0.839802
[59]	validation_0-auc:0.88207	validation_1-auc:0.839893
[60]	validation_0-auc:0.882308	validation_1-auc:0.839798
[61]	validation_0-auc:0.882496	validation_1-auc:0.839839
[62]	validation_0-auc:0.882773	validation_1-auc:0.840109
[63]	validation_0-auc:0.882998	validation_1-auc:0.840266
[64]	validation_0-auc:0.883255	validation_1-auc:0.840344
[65]	validation_0-auc:0.883839	validation_1-auc:0.84025
[66]	validation_0-auc:0.884351	validation_1-auc:0.840166
[67]	validation_0-auc:0.884494	validation_1-auc:0.840336
[68]	validation_0-auc:0.884483	validation_1-auc:0.840109
[69]	validation_0-auc:0.884645	validation_1-auc:0.840109
[70]	validation_0-auc:0.885017	validation_1-auc:0.840008
[71]	validation_0-auc:0.885442	validation_1-auc:0.84015
[72]	validation_0-auc:0.885586	validation_1-auc:0.840144
[73]	validation_0-auc:0.885848	validation_1-auc:0.839893
[74]	validation_0-auc:0.885959	validation_1-auc:0.839767
[75]	validation_0-auc:0.886193	validation_1-auc:0.839632
[76]	validation_0-auc:0.886371	validation_1-auc:0.83974
[77]	validation_0-auc:0.886595	validation_1-auc:0.839835
[78]	validation_0-auc:0.886884	validation_1-auc:0.839834
[79]	validation_0-auc:0.886914	validation_1-auc:0.839847
[80]	validation_0-auc:0.887232	validation_1-auc:0.839673
[81]	validation_0-auc:0.887272	validation_1-auc:0.839616
[82]	validation_0-auc:0.887387	validation_1-auc:0.839621
[83]	validation_0-auc:0.887403	validation_1-auc:0.839555
[84]	validation_0-auc:0.887468	validation_1-auc:0.839641
[85]	validation_0-auc:0.887562	validation_1-auc:0.83935
[86]	validation_0-auc:0.887613	validation_1-auc:0.839496
[87]	validation_0-auc:0.887752	validation_1-auc:0.839428
[88]	validation_0-auc:0.887826	validation_1-auc:0.839397
[89]	validation_0-auc:0.888306	validation_1-auc:0.839105
[90]	validation_0-auc:0.888714	validation_1-auc:0.839036
[91]	validation_0-auc:0.88877	validation_1-auc:0.83897
[92]	validation_0-auc:0.889068	validation_1-auc:0.838877
[93]	validation_0-auc:0.889147	validation_1-auc:0.838776
[94]	validation_0-auc:0.889365	validation_1-auc:0.838923
Stopping. Best iteration:
[64]	validation_0-auc:0.883255	validation_1-auc:0.840344

[0]	validation_0-auc:0.717789	validation_1-auc:0.725883
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 30 rounds.
[1]	validation_0-auc:0.813145	validation_1-auc:0.810172
[2]	validation_0-auc:0.80703	validation_1-auc:0.804987
[3]	validation_0-auc:0.820275	validation_1-auc:0.818605
[4]	validation_0-auc:0.829276	validation_1-auc:0.826364
[5]	validation_0-auc:0.82342	validation_1-auc:0.822503
[6]	validation_0-auc:0.822274	validation_1-auc:0.821212
[7]	validation_0-auc:0.827022	validation_1-auc:0.825357
[8]	validation_0-auc:0.833457	validation_1-auc:0.830616
[9]	validation_0-auc:0.832242	validation_1-auc:0.829654
[10]	validation_0-auc:0.835096	validation_1-auc:0.830808
[11]	validation_0-auc:0.837381	validation_1-auc:0.832154
[12]	validation_0-auc:0.839594	validation_1-auc:0.832462
[13]	validation_0-auc:0.839359	validation_1-auc:0.832758
[14]	validation_0-auc:0.839461	validation_1-auc:0.83217
[15]	validation_0-auc:0.841481	validation_1-auc:0.834596
[16]	validation_0-auc:0.84335	validation_1-auc:0.835303
[17]	validation_0-auc:0.845717	validation_1-auc:0.837657
[18]	validation_0-auc:0.847511	validation_1-auc:0.83989
[19]	validation_0-auc:0.846482	validation_1-auc:0.838554
[20]	validation_0-auc:0.848726	validation_1-auc:0.840214
[21]	validation_0-auc:0.847695	validation_1-auc:0.838583
[22]	validation_0-auc:0.84676	validation_1-auc:0.838167
[23]	validation_0-auc:0.848966	validation_1-auc:0.83963
[24]	validation_0-auc:0.850153	validation_1-auc:0.840161
[25]	validation_0-auc:0.850518	validation_1-auc:0.838865
[26]	validation_0-auc:0.850326	validation_1-auc:0.83861
[27]	validation_0-auc:0.851898	validation_1-auc:0.839714
[28]	validation_0-auc:0.853439	validation_1-auc:0.83974
[29]	validation_0-auc:0.853446	validation_1-auc:0.840649
[30]	validation_0-auc:0.854315	validation_1-auc:0.840818
[31]	validation_0-auc:0.855389	validation_1-auc:0.841412
[32]	validation_0-auc:0.855959	validation_1-auc:0.841502
[33]	validation_0-auc:0.856346	validation_1-auc:0.841478
[34]	validation_0-auc:0.856286	validation_1-auc:0.841234
[35]	validation_0-auc:0.857969	validation_1-auc:0.842276
[36]	validation_0-auc:0.859291	validation_1-auc:0.842627
[37]	validation_0-auc:0.859418	validation_1-auc:0.84241
[38]	validation_0-auc:0.860148	validation_1-auc:0.842336
[39]	validation_0-auc:0.860092	validation_1-auc:0.842596
[40]	validation_0-auc:0.860714	validation_1-auc:0.842225
[41]	validation_0-auc:0.86102	validation_1-auc:0.841878
[42]	validation_0-auc:0.862245	validation_1-auc:0.842387
[43]	validation_0-auc:0.86228	validation_1-auc:0.842109
[44]	validation_0-auc:0.863492	validation_1-auc:0.842518
[45]	validation_0-auc:0.864029	validation_1-auc:0.842132
[46]	validation_0-auc:0.86511	validation_1-auc:0.842687
[47]	validation_0-auc:0.865765	validation_1-auc:0.84359
[48]	validation_0-auc:0.866413	validation_1-auc:0.843371
[49]	validation_0-auc:0.867119	validation_1-auc:0.843521
[50]	validation_0-auc:0.867502	validation_1-auc:0.843723
[51]	validation_0-auc:0.868477	validation_1-auc:0.844189
[52]	validation_0-auc:0.86902	validation_1-auc:0.844987
[53]	validation_0-auc:0.869566	validation_1-auc:0.845122
[54]	validation_0-auc:0.870345	validation_1-auc:0.845578
[55]	validation_0-auc:0.870851	validation_1-auc:0.844909
[56]	validation_0-auc:0.871427	validation_1-auc:0.845604
[57]	validation_0-auc:0.871999	validation_1-auc:0.845879
[58]	validation_0-auc:0.872473	validation_1-auc:0.845742
[59]	validation_0-auc:0.872719	validation_1-auc:0.845634
[60]	validation_0-auc:0.873232	validation_1-auc:0.845628
[61]	validation_0-auc:0.873589	validation_1-auc:0.84568
[62]	validation_0-auc:0.873928	validation_1-auc:0.845631
[63]	validation_0-auc:0.874383	validation_1-auc:0.845616
[64]	validation_0-auc:0.874808	validation_1-auc:0.845449
[65]	validation_0-auc:0.875236	validation_1-auc:0.845193
[66]	validation_0-auc:0.875355	validation_1-auc:0.845183
[67]	validation_0-auc:0.875632	validation_1-auc:0.845193
[68]	validation_0-auc:0.876032	validation_1-auc:0.845069
[69]	validation_0-auc:0.876196	validation_1-auc:0.845377
[70]	validation_0-auc:0.876492	validation_1-auc:0.845464
[71]	validation_0-auc:0.876668	validation_1-auc:0.845595
[72]	validation_0-auc:0.87697	validation_1-auc:0.8456
[73]	validation_0-auc:0.877193	validation_1-auc:0.845648
[74]	validation_0-auc:0.877296	validation_1-auc:0.845525
[75]	validation_0-auc:0.877818	validation_1-auc:0.845561
[76]	validation_0-auc:0.87795	validation_1-auc:0.845778
[77]	validation_0-auc:0.878264	validation_1-auc:0.845629
[78]	validation_0-auc:0.87845	validation_1-auc:0.845657
[79]	validation_0-auc:0.878938	validation_1-auc:0.845663
[80]	validation_0-auc:0.879047	validation_1-auc:0.845639
[81]	validation_0-auc:0.879656	validation_1-auc:0.845852
[82]	validation_0-auc:0.87973	validation_1-auc:0.845831
[83]	validation_0-auc:0.88004	validation_1-auc:0.84589
[84]	validation_0-auc:0.88027	validation_1-auc:0.845772
[85]	validation_0-auc:0.880452	validation_1-auc:0.845903
[86]	validation_0-auc:0.880814	validation_1-auc:0.845886
[87]	validation_0-auc:0.881284	validation_1-auc:0.846018
[88]	validation_0-auc:0.881384	validation_1-auc:0.84606
[89]	validation_0-auc:0.88152	validation_1-auc:0.846035
[90]	validation_0-auc:0.881853	validation_1-auc:0.845866
[91]	validation_0-auc:0.882031	validation_1-auc:0.845859
[92]	validation_0-auc:0.882109	validation_1-auc:0.845845
[93]	validation_0-auc:0.882179	validation_1-auc:0.845926
[94]	validation_0-auc:0.882323	validation_1-auc:0.845717
[95]	validation_0-auc:0.882451	validation_1-auc:0.845581
[96]	validation_0-auc:0.882524	validation_1-auc:0.845596
[97]	validation_0-auc:0.882802	validation_1-auc:0.845507
[98]	validation_0-auc:0.883136	validation_1-auc:0.845464
[99]	validation_0-auc:0.883211	validation_1-auc:0.845508
GridSearchCV 최적 파라미터: {'colsample_bytree': 0.5, 'max_depth': 5, 'min_child_weight': 1}
ROC AUC: 0.8461

In [17]:

# GridSearchCV 최적 파라미터: {'colsample_bytree': 0.5, 'max_depth': 5, 'min_child_weight': 1}
# ROC AUC: 0.8461

# n_estimators는 1000으로 증가시키고, learning_rate=0.02로 감소, reg_alpha=0.03으로 추가함. 
xgb_clf = XGBClassifier(n_estimators=1000, random_state=156, learning_rate=0.02, max_depth=5,\
                        min_child_weight=1, colsample_bytree=0.5, reg_alpha=0.03)

# evaluation metric을 auc로, early stopping은 200 으로 설정하고 학습 수행. 
xgb_clf.fit(X_train, y_train, early_stopping_rounds=200, 
            eval_metric="auc",eval_set=[(X_train, y_train), (X_test, y_test)])

xgb_roc_score = roc_auc_score(y_test, xgb_clf.predict_proba(X_test)[:,1],average='macro')
print('ROC AUC: {0:.4f}'.format(xgb_roc_score))

[0]	validation_0-auc:0.817665	validation_1-auc:0.814986
Multiple eval metrics have been passed: 'validation_1-auc' will be used for early stopping.

Will train until validation_1-auc hasn't improved in 200 rounds.
[1]	validation_0-auc:0.81987	validation_1-auc:0.814699
[2]	validation_0-auc:0.818798	validation_1-auc:0.813863
[3]	validation_0-auc:0.821696	validation_1-auc:0.815841
[4]	validation_0-auc:0.827716	validation_1-auc:0.822558
[5]	validation_0-auc:0.822253	validation_1-auc:0.818887
[6]	validation_0-auc:0.825218	validation_1-auc:0.818733
[7]	validation_0-auc:0.826898	validation_1-auc:0.820357
[8]	validation_0-auc:0.832836	validation_1-auc:0.827253
[9]	validation_0-auc:0.833574	validation_1-auc:0.827534
[10]	validation_0-auc:0.832205	validation_1-auc:0.825896
[11]	validation_0-auc:0.829664	validation_1-auc:0.824912
[12]	validation_0-auc:0.828593	validation_1-auc:0.824409
[13]	validation_0-auc:0.829674	validation_1-auc:0.824657
[14]	validation_0-auc:0.833554	validation_1-auc:0.827825
[15]	validation_0-auc:0.830766	validation_1-auc:0.825158
[16]	validation_0-auc:0.833021	validation_1-auc:0.82671
[17]	validation_0-auc:0.834975	validation_1-auc:0.828983
[18]	validation_0-auc:0.836437	validation_1-auc:0.830773
[19]	validation_0-auc:0.835064	validation_1-auc:0.829887
[20]	validation_0-auc:0.832475	validation_1-auc:0.827949
[21]	validation_0-auc:0.831277	validation_1-auc:0.827163
[22]	validation_0-auc:0.830617	validation_1-auc:0.826171
[23]	validation_0-auc:0.829235	validation_1-auc:0.825373
[24]	validation_0-auc:0.830852	validation_1-auc:0.826548
[25]	validation_0-auc:0.832521	validation_1-auc:0.828285
[26]	validation_0-auc:0.833232	validation_1-auc:0.829277
[27]	validation_0-auc:0.831988	validation_1-auc:0.828688
[28]	validation_0-auc:0.830372	validation_1-auc:0.827289
[29]	validation_0-auc:0.829213	validation_1-auc:0.826107
[30]	validation_0-auc:0.831061	validation_1-auc:0.827695
[31]	validation_0-auc:0.83303	validation_1-auc:0.829382
[32]	validation_0-auc:0.831545	validation_1-auc:0.828004
[33]	validation_0-auc:0.83327	validation_1-auc:0.830019
[34]	validation_0-auc:0.832261	validation_1-auc:0.828957
[35]	validation_0-auc:0.833312	validation_1-auc:0.830526
[36]	validation_0-auc:0.832202	validation_1-auc:0.829596
[37]	validation_0-auc:0.833092	validation_1-auc:0.829786
[38]	validation_0-auc:0.832276	validation_1-auc:0.829409
[39]	validation_0-auc:0.831351	validation_1-auc:0.828511
[40]	validation_0-auc:0.830747	validation_1-auc:0.827882
[41]	validation_0-auc:0.831879	validation_1-auc:0.829086
[42]	validation_0-auc:0.831497	validation_1-auc:0.828784
[43]	validation_0-auc:0.830774	validation_1-auc:0.827842
[44]	validation_0-auc:0.829944	validation_1-auc:0.82735
[45]	validation_0-auc:0.831328	validation_1-auc:0.828282
[46]	validation_0-auc:0.832461	validation_1-auc:0.829687
[47]	validation_0-auc:0.831995	validation_1-auc:0.829067
[48]	validation_0-auc:0.832787	validation_1-auc:0.829742
[49]	validation_0-auc:0.832533	validation_1-auc:0.829413
[50]	validation_0-auc:0.831679	validation_1-auc:0.828392
[51]	validation_0-auc:0.832683	validation_1-auc:0.82951
[52]	validation_0-auc:0.831904	validation_1-auc:0.828653
[53]	validation_0-auc:0.833138	validation_1-auc:0.829458
[54]	validation_0-auc:0.832623	validation_1-auc:0.828944
[55]	validation_0-auc:0.832389	validation_1-auc:0.828624
[56]	validation_0-auc:0.832252	validation_1-auc:0.82842
[57]	validation_0-auc:0.832835	validation_1-auc:0.829046
[58]	validation_0-auc:0.832613	validation_1-auc:0.828993
[59]	validation_0-auc:0.833333	validation_1-auc:0.829606
[60]	validation_0-auc:0.833026	validation_1-auc:0.828905
[61]	validation_0-auc:0.833992	validation_1-auc:0.829584
[62]	validation_0-auc:0.834677	validation_1-auc:0.830244
[63]	validation_0-auc:0.834427	validation_1-auc:0.829454
[64]	validation_0-auc:0.833861	validation_1-auc:0.82917
[65]	validation_0-auc:0.834923	validation_1-auc:0.82993
[66]	validation_0-auc:0.83425	validation_1-auc:0.82944
[67]	validation_0-auc:0.835119	validation_1-auc:0.83011
[68]	validation_0-auc:0.835884	validation_1-auc:0.830558
[69]	validation_0-auc:0.835497	validation_1-auc:0.829999
[70]	validation_0-auc:0.835271	validation_1-auc:0.82968
[71]	validation_0-auc:0.836145	validation_1-auc:0.830278
[72]	validation_0-auc:0.835888	validation_1-auc:0.830077
[73]	validation_0-auc:0.83546	validation_1-auc:0.829685
[74]	validation_0-auc:0.836187	validation_1-auc:0.830492
[75]	validation_0-auc:0.83707	validation_1-auc:0.831099
[76]	validation_0-auc:0.836779	validation_1-auc:0.830706
[77]	validation_0-auc:0.837626	validation_1-auc:0.831204
[78]	validation_0-auc:0.839114	validation_1-auc:0.832069
[79]	validation_0-auc:0.839648	validation_1-auc:0.832501
[80]	validation_0-auc:0.84027	validation_1-auc:0.832883
[81]	validation_0-auc:0.840287	validation_1-auc:0.832429
[82]	validation_0-auc:0.84076	validation_1-auc:0.83265
[83]	validation_0-auc:0.840425	validation_1-auc:0.832506
[84]	validation_0-auc:0.840934	validation_1-auc:0.83285
[85]	validation_0-auc:0.840768	validation_1-auc:0.832666
[86]	validation_0-auc:0.841512	validation_1-auc:0.833109
[87]	validation_0-auc:0.841932	validation_1-auc:0.83352
[88]	validation_0-auc:0.841849	validation_1-auc:0.833404
[89]	validation_0-auc:0.842721	validation_1-auc:0.833988
[90]	validation_0-auc:0.843463	validation_1-auc:0.83443
[91]	validation_0-auc:0.844128	validation_1-auc:0.834798
[92]	validation_0-auc:0.843865	validation_1-auc:0.834701
[93]	validation_0-auc:0.844291	validation_1-auc:0.835085
[94]	validation_0-auc:0.844684	validation_1-auc:0.835541
[95]	validation_0-auc:0.844625	validation_1-auc:0.835452
[96]	validation_0-auc:0.844601	validation_1-auc:0.835154
[97]	validation_0-auc:0.844405	validation_1-auc:0.835047
[98]	validation_0-auc:0.844898	validation_1-auc:0.835661
[99]	validation_0-auc:0.844637	validation_1-auc:0.835043
[100]	validation_0-auc:0.844676	validation_1-auc:0.83482
[101]	validation_0-auc:0.844343	validation_1-auc:0.834528
[102]	validation_0-auc:0.844177	validation_1-auc:0.834003
[103]	validation_0-auc:0.844085	validation_1-auc:0.833539
[104]	validation_0-auc:0.843439	validation_1-auc:0.833486
[105]	validation_0-auc:0.843054	validation_1-auc:0.833192
[106]	validation_0-auc:0.843666	validation_1-auc:0.833383
[107]	validation_0-auc:0.843418	validation_1-auc:0.833347
[108]	validation_0-auc:0.843023	validation_1-auc:0.833173
[109]	validation_0-auc:0.844116	validation_1-auc:0.833892
[110]	validation_0-auc:0.843794	validation_1-auc:0.833821
[111]	validation_0-auc:0.844503	validation_1-auc:0.834265
[112]	validation_0-auc:0.844339	validation_1-auc:0.834014
[113]	validation_0-auc:0.843671	validation_1-auc:0.833795
[114]	validation_0-auc:0.843643	validation_1-auc:0.833778
[115]	validation_0-auc:0.844765	validation_1-auc:0.834236
[116]	validation_0-auc:0.844198	validation_1-auc:0.834199
[117]	validation_0-auc:0.845286	validation_1-auc:0.834426
[118]	validation_0-auc:0.845755	validation_1-auc:0.83492
[119]	validation_0-auc:0.845945	validation_1-auc:0.834536
[120]	validation_0-auc:0.845912	validation_1-auc:0.834462
[121]	validation_0-auc:0.845275	validation_1-auc:0.834307
[122]	validation_0-auc:0.845027	validation_1-auc:0.834423
[123]	validation_0-auc:0.845966	validation_1-auc:0.834644
[124]	validation_0-auc:0.8466	validation_1-auc:0.835346
[125]	validation_0-auc:0.847112	validation_1-auc:0.83576
[126]	validation_0-auc:0.847155	validation_1-auc:0.835731
[127]	validation_0-auc:0.846885	validation_1-auc:0.83576
[128]	validation_0-auc:0.847264	validation_1-auc:0.836102
[129]	validation_0-auc:0.84719	validation_1-auc:0.83611
[130]	validation_0-auc:0.847643	validation_1-auc:0.836321
[131]	validation_0-auc:0.84785	validation_1-auc:0.836245
[132]	validation_0-auc:0.847597	validation_1-auc:0.8361
[133]	validation_0-auc:0.847493	validation_1-auc:0.835909
[134]	validation_0-auc:0.847978	validation_1-auc:0.836585
[135]	validation_0-auc:0.848053	validation_1-auc:0.83614
[136]	validation_0-auc:0.848445	validation_1-auc:0.836453
[137]	validation_0-auc:0.848636	validation_1-auc:0.836338
[138]	validation_0-auc:0.849198	validation_1-auc:0.836557
[139]	validation_0-auc:0.849111	validation_1-auc:0.836556
[140]	validation_0-auc:0.849671	validation_1-auc:0.83676
[141]	validation_0-auc:0.849536	validation_1-auc:0.836687
[142]	validation_0-auc:0.849348	validation_1-auc:0.836678
[143]	validation_0-auc:0.849269	validation_1-auc:0.836577
[144]	validation_0-auc:0.849391	validation_1-auc:0.836424
[145]	validation_0-auc:0.849916	validation_1-auc:0.836743
[146]	validation_0-auc:0.85042	validation_1-auc:0.836944
[147]	validation_0-auc:0.850383	validation_1-auc:0.836989
[148]	validation_0-auc:0.850363	validation_1-auc:0.836965
[149]	validation_0-auc:0.850218	validation_1-auc:0.836789
[150]	validation_0-auc:0.850234	validation_1-auc:0.836592
[151]	validation_0-auc:0.850204	validation_1-auc:0.836563
[152]	validation_0-auc:0.850034	validation_1-auc:0.836528
[153]	validation_0-auc:0.849802	validation_1-auc:0.836464
[154]	validation_0-auc:0.850504	validation_1-auc:0.83684
[155]	validation_0-auc:0.850392	validation_1-auc:0.836639
[156]	validation_0-auc:0.851078	validation_1-auc:0.837145
[157]	validation_0-auc:0.851537	validation_1-auc:0.837666
[158]	validation_0-auc:0.851938	validation_1-auc:0.837948
[159]	validation_0-auc:0.85207	validation_1-auc:0.837736
[160]	validation_0-auc:0.852061	validation_1-auc:0.837533
[161]	validation_0-auc:0.852183	validation_1-auc:0.837455
[162]	validation_0-auc:0.852658	validation_1-auc:0.837688
[163]	validation_0-auc:0.852722	validation_1-auc:0.83769
[164]	validation_0-auc:0.852737	validation_1-auc:0.837609
[165]	validation_0-auc:0.853427	validation_1-auc:0.837897
[166]	validation_0-auc:0.853917	validation_1-auc:0.83856
[167]	validation_0-auc:0.854404	validation_1-auc:0.839036
[168]	validation_0-auc:0.854487	validation_1-auc:0.838629
[169]	validation_0-auc:0.854494	validation_1-auc:0.838548
[170]	validation_0-auc:0.854438	validation_1-auc:0.838537
[171]	validation_0-auc:0.854479	validation_1-auc:0.838402
[172]	validation_0-auc:0.854836	validation_1-auc:0.838831
[173]	validation_0-auc:0.855311	validation_1-auc:0.839087
[174]	validation_0-auc:0.855755	validation_1-auc:0.8394
[175]	validation_0-auc:0.855779	validation_1-auc:0.839272
[176]	validation_0-auc:0.856174	validation_1-auc:0.839624
[177]	validation_0-auc:0.856243	validation_1-auc:0.839611
[178]	validation_0-auc:0.856339	validation_1-auc:0.83953
[179]	validation_0-auc:0.856373	validation_1-auc:0.839483
[180]	validation_0-auc:0.856353	validation_1-auc:0.839366
[181]	validation_0-auc:0.856734	validation_1-auc:0.839805
[182]	validation_0-auc:0.857053	validation_1-auc:0.840158
[183]	validation_0-auc:0.857133	validation_1-auc:0.839915
[184]	validation_0-auc:0.857536	validation_1-auc:0.840228
[185]	validation_0-auc:0.857565	validation_1-auc:0.840162
[186]	validation_0-auc:0.857632	validation_1-auc:0.839945
[187]	validation_0-auc:0.857981	validation_1-auc:0.840538
[188]	validation_0-auc:0.858278	validation_1-auc:0.84065
[189]	validation_0-auc:0.858596	validation_1-auc:0.841005
[190]	validation_0-auc:0.858596	validation_1-auc:0.840881
[191]	validation_0-auc:0.858679	validation_1-auc:0.840794
[192]	validation_0-auc:0.858928	validation_1-auc:0.841032
[193]	validation_0-auc:0.858916	validation_1-auc:0.84107
[194]	validation_0-auc:0.859224	validation_1-auc:0.841194
[195]	validation_0-auc:0.859234	validation_1-auc:0.841241
[196]	validation_0-auc:0.859566	validation_1-auc:0.841391
[197]	validation_0-auc:0.859888	validation_1-auc:0.841742
[198]	validation_0-auc:0.860245	validation_1-auc:0.84202
[199]	validation_0-auc:0.860289	validation_1-auc:0.841929
[200]	validation_0-auc:0.860329	validation_1-auc:0.841836
[201]	validation_0-auc:0.860707	validation_1-auc:0.842101
[202]	validation_0-auc:0.860626	validation_1-auc:0.84218
[203]	validation_0-auc:0.860738	validation_1-auc:0.842017
[204]	validation_0-auc:0.860782	validation_1-auc:0.841857
[205]	validation_0-auc:0.860843	validation_1-auc:0.841663
[206]	validation_0-auc:0.860996	validation_1-auc:0.84156
[207]	validation_0-auc:0.861277	validation_1-auc:0.841835
[208]	validation_0-auc:0.861595	validation_1-auc:0.84204
[209]	validation_0-auc:0.862006	validation_1-auc:0.842368
[210]	validation_0-auc:0.862266	validation_1-auc:0.842535
[211]	validation_0-auc:0.862521	validation_1-auc:0.842676
[212]	validation_0-auc:0.862747	validation_1-auc:0.843028
[213]	validation_0-auc:0.862802	validation_1-auc:0.842882
[214]	validation_0-auc:0.863048	validation_1-auc:0.843111
[215]	validation_0-auc:0.863121	validation_1-auc:0.843124
[216]	validation_0-auc:0.863238	validation_1-auc:0.843024
[217]	validation_0-auc:0.86355	validation_1-auc:0.843285
[218]	validation_0-auc:0.863558	validation_1-auc:0.843338
[219]	validation_0-auc:0.863592	validation_1-auc:0.843405
[220]	validation_0-auc:0.863594	validation_1-auc:0.843387
[221]	validation_0-auc:0.863633	validation_1-auc:0.843276
[222]	validation_0-auc:0.863859	validation_1-auc:0.843523
[223]	validation_0-auc:0.864094	validation_1-auc:0.843677
[224]	validation_0-auc:0.864407	validation_1-auc:0.843736
[225]	validation_0-auc:0.864536	validation_1-auc:0.843694
[226]	validation_0-auc:0.864815	validation_1-auc:0.843786
[227]	validation_0-auc:0.865008	validation_1-auc:0.843851
[228]	validation_0-auc:0.865234	validation_1-auc:0.844038
[229]	validation_0-auc:0.865268	validation_1-auc:0.844109
[230]	validation_0-auc:0.865507	validation_1-auc:0.844145
[231]	validation_0-auc:0.86564	validation_1-auc:0.844165
[232]	validation_0-auc:0.865821	validation_1-auc:0.844401
[233]	validation_0-auc:0.865988	validation_1-auc:0.844421
[234]	validation_0-auc:0.866163	validation_1-auc:0.844574
[235]	validation_0-auc:0.866338	validation_1-auc:0.844699
[236]	validation_0-auc:0.866523	validation_1-auc:0.844673
[237]	validation_0-auc:0.866544	validation_1-auc:0.844652
[238]	validation_0-auc:0.866783	validation_1-auc:0.844751
[239]	validation_0-auc:0.866944	validation_1-auc:0.844709
[240]	validation_0-auc:0.867086	validation_1-auc:0.844707
[241]	validation_0-auc:0.867121	validation_1-auc:0.844642
[242]	validation_0-auc:0.86739	validation_1-auc:0.844738
[243]	validation_0-auc:0.867427	validation_1-auc:0.844646
[244]	validation_0-auc:0.867626	validation_1-auc:0.844689
[245]	validation_0-auc:0.867734	validation_1-auc:0.844898
[246]	validation_0-auc:0.867866	validation_1-auc:0.844804
[247]	validation_0-auc:0.868033	validation_1-auc:0.844937
[248]	validation_0-auc:0.868118	validation_1-auc:0.844867
[249]	validation_0-auc:0.868226	validation_1-auc:0.84478
[250]	validation_0-auc:0.868276	validation_1-auc:0.844789
[251]	validation_0-auc:0.868464	validation_1-auc:0.844754
[252]	validation_0-auc:0.868613	validation_1-auc:0.844907
[253]	validation_0-auc:0.868738	validation_1-auc:0.845011
[254]	validation_0-auc:0.868974	validation_1-auc:0.845186
[255]	validation_0-auc:0.869018	validation_1-auc:0.845155
[256]	validation_0-auc:0.869214	validation_1-auc:0.845116
[257]	validation_0-auc:0.869371	validation_1-auc:0.845107
[258]	validation_0-auc:0.869354	validation_1-auc:0.845008
[259]	validation_0-auc:0.869494	validation_1-auc:0.844904
[260]	validation_0-auc:0.869598	validation_1-auc:0.844895
[261]	validation_0-auc:0.869699	validation_1-auc:0.844794
[262]	validation_0-auc:0.869848	validation_1-auc:0.844879
[263]	validation_0-auc:0.869912	validation_1-auc:0.844879
[264]	validation_0-auc:0.870103	validation_1-auc:0.844912
[265]	validation_0-auc:0.870247	validation_1-auc:0.844889
[266]	validation_0-auc:0.870363	validation_1-auc:0.844977
[267]	validation_0-auc:0.87056	validation_1-auc:0.845121
[268]	validation_0-auc:0.870641	validation_1-auc:0.845051
[269]	validation_0-auc:0.870733	validation_1-auc:0.845158
[270]	validation_0-auc:0.870802	validation_1-auc:0.845205
[271]	validation_0-auc:0.870942	validation_1-auc:0.845285
[272]	validation_0-auc:0.87106	validation_1-auc:0.845386
[273]	validation_0-auc:0.871148	validation_1-auc:0.845443
[274]	validation_0-auc:0.871195	validation_1-auc:0.845448
[275]	validation_0-auc:0.871245	validation_1-auc:0.8455
[276]	validation_0-auc:0.871402	validation_1-auc:0.845476
[277]	validation_0-auc:0.871521	validation_1-auc:0.845502
[278]	validation_0-auc:0.871696	validation_1-auc:0.845515
[279]	validation_0-auc:0.871845	validation_1-auc:0.845611
[280]	validation_0-auc:0.872014	validation_1-auc:0.845506
[281]	validation_0-auc:0.87206	validation_1-auc:0.845578
[282]	validation_0-auc:0.872216	validation_1-auc:0.845531
[283]	validation_0-auc:0.872343	validation_1-auc:0.845565
[284]	validation_0-auc:0.872479	validation_1-auc:0.845562
[285]	validation_0-auc:0.872547	validation_1-auc:0.845534
[286]	validation_0-auc:0.872653	validation_1-auc:0.845593
[287]	validation_0-auc:0.872682	validation_1-auc:0.845595
[288]	validation_0-auc:0.872825	validation_1-auc:0.845551
[289]	validation_0-auc:0.872967	validation_1-auc:0.845586
[290]	validation_0-auc:0.873032	validation_1-auc:0.845515
[291]	validation_0-auc:0.873085	validation_1-auc:0.845531
[292]	validation_0-auc:0.873181	validation_1-auc:0.845631
[293]	validation_0-auc:0.873315	validation_1-auc:0.845542
[294]	validation_0-auc:0.873348	validation_1-auc:0.845573
[295]	validation_0-auc:0.873491	validation_1-auc:0.845533
[296]	validation_0-auc:0.873609	validation_1-auc:0.845548
[297]	validation_0-auc:0.873675	validation_1-auc:0.845466
[298]	validation_0-auc:0.873803	validation_1-auc:0.845508
[299]	validation_0-auc:0.873925	validation_1-auc:0.845664
[300]	validation_0-auc:0.873967	validation_1-auc:0.845631
[301]	validation_0-auc:0.874076	validation_1-auc:0.845699
[302]	validation_0-auc:0.874116	validation_1-auc:0.845645
[303]	validation_0-auc:0.874248	validation_1-auc:0.845681
[304]	validation_0-auc:0.874278	validation_1-auc:0.845603
[305]	validation_0-auc:0.874384	validation_1-auc:0.845553
[306]	validation_0-auc:0.87441	validation_1-auc:0.845587
[307]	validation_0-auc:0.874549	validation_1-auc:0.84561
[308]	validation_0-auc:0.874697	validation_1-auc:0.845741
[309]	validation_0-auc:0.874789	validation_1-auc:0.845731
[310]	validation_0-auc:0.874874	validation_1-auc:0.845709
[311]	validation_0-auc:0.874904	validation_1-auc:0.845695
[312]	validation_0-auc:0.875029	validation_1-auc:0.845729
[313]	validation_0-auc:0.875077	validation_1-auc:0.845704
[314]	validation_0-auc:0.875113	validation_1-auc:0.845658
[315]	validation_0-auc:0.87525	validation_1-auc:0.845646
[316]	validation_0-auc:0.875355	validation_1-auc:0.845657
[317]	validation_0-auc:0.875459	validation_1-auc:0.845685
[318]	validation_0-auc:0.875524	validation_1-auc:0.845717
[319]	validation_0-auc:0.875582	validation_1-auc:0.845714
[320]	validation_0-auc:0.875659	validation_1-auc:0.84581
[321]	validation_0-auc:0.875731	validation_1-auc:0.845808
[322]	validation_0-auc:0.875799	validation_1-auc:0.845917
[323]	validation_0-auc:0.875895	validation_1-auc:0.845808
[324]	validation_0-auc:0.875972	validation_1-auc:0.845828
[325]	validation_0-auc:0.876076	validation_1-auc:0.845782
[326]	validation_0-auc:0.876175	validation_1-auc:0.845772
[327]	validation_0-auc:0.876346	validation_1-auc:0.845763
[328]	validation_0-auc:0.876491	validation_1-auc:0.845705
[329]	validation_0-auc:0.876573	validation_1-auc:0.845699
[330]	validation_0-auc:0.876611	validation_1-auc:0.845699
[331]	validation_0-auc:0.876688	validation_1-auc:0.845702
[332]	validation_0-auc:0.876752	validation_1-auc:0.845676
[333]	validation_0-auc:0.876775	validation_1-auc:0.84572
[334]	validation_0-auc:0.876892	validation_1-auc:0.845677
[335]	validation_0-auc:0.876973	validation_1-auc:0.845737
[336]	validation_0-auc:0.877035	validation_1-auc:0.845729
[337]	validation_0-auc:0.877084	validation_1-auc:0.845729
[338]	validation_0-auc:0.877118	validation_1-auc:0.845699
[339]	validation_0-auc:0.877167	validation_1-auc:0.845708
[340]	validation_0-auc:0.877252	validation_1-auc:0.845652
[341]	validation_0-auc:0.877358	validation_1-auc:0.845591
[342]	validation_0-auc:0.877432	validation_1-auc:0.845613
[343]	validation_0-auc:0.877457	validation_1-auc:0.845618
[344]	validation_0-auc:0.87753	validation_1-auc:0.845667
[345]	validation_0-auc:0.877632	validation_1-auc:0.845606
[346]	validation_0-auc:0.877722	validation_1-auc:0.845566
[347]	validation_0-auc:0.877791	validation_1-auc:0.845528
[348]	validation_0-auc:0.877858	validation_1-auc:0.845513
[349]	validation_0-auc:0.877967	validation_1-auc:0.845508
[350]	validation_0-auc:0.878035	validation_1-auc:0.845514
[351]	validation_0-auc:0.878074	validation_1-auc:0.845493
[352]	validation_0-auc:0.878177	validation_1-auc:0.845463
[353]	validation_0-auc:0.878234	validation_1-auc:0.845473
[354]	validation_0-auc:0.878255	validation_1-auc:0.84544
[355]	validation_0-auc:0.878351	validation_1-auc:0.845391
[356]	validation_0-auc:0.878446	validation_1-auc:0.845414
[357]	validation_0-auc:0.878523	validation_1-auc:0.845412
[358]	validation_0-auc:0.878628	validation_1-auc:0.845388
[359]	validation_0-auc:0.878758	validation_1-auc:0.845403
[360]	validation_0-auc:0.878889	validation_1-auc:0.845359
[361]	validation_0-auc:0.878965	validation_1-auc:0.845314
[362]	validation_0-auc:0.879043	validation_1-auc:0.845225
[363]	validation_0-auc:0.879141	validation_1-auc:0.845234
[364]	validation_0-auc:0.879257	validation_1-auc:0.845207
[365]	validation_0-auc:0.879324	validation_1-auc:0.845185
[366]	validation_0-auc:0.879393	validation_1-auc:0.845201
[367]	validation_0-auc:0.879457	validation_1-auc:0.845166
[368]	validation_0-auc:0.879564	validation_1-auc:0.845159
[369]	validation_0-auc:0.87966	validation_1-auc:0.845206
[370]	validation_0-auc:0.879685	validation_1-auc:0.845196
[371]	validation_0-auc:0.87976	validation_1-auc:0.845217
[372]	validation_0-auc:0.879858	validation_1-auc:0.845149
[373]	validation_0-auc:0.879875	validation_1-auc:0.845132
[374]	validation_0-auc:0.879954	validation_1-auc:0.84518
[375]	validation_0-auc:0.880025	validation_1-auc:0.845172
[376]	validation_0-auc:0.880059	validation_1-auc:0.845141
[377]	validation_0-auc:0.880148	validation_1-auc:0.845115
[378]	validation_0-auc:0.880287	validation_1-auc:0.845159
[379]	validation_0-auc:0.880354	validation_1-auc:0.845207
[380]	validation_0-auc:0.880444	validation_1-auc:0.84519
[381]	validation_0-auc:0.880483	validation_1-auc:0.845165
[382]	validation_0-auc:0.880532	validation_1-auc:0.845178
[383]	validation_0-auc:0.880634	validation_1-auc:0.845182
[384]	validation_0-auc:0.880726	validation_1-auc:0.845227
[385]	validation_0-auc:0.880827	validation_1-auc:0.845257
[386]	validation_0-auc:0.880848	validation_1-auc:0.845257
[387]	validation_0-auc:0.88088	validation_1-auc:0.845237
[388]	validation_0-auc:0.880959	validation_1-auc:0.845192
[389]	validation_0-auc:0.881014	validation_1-auc:0.845149
[390]	validation_0-auc:0.881093	validation_1-auc:0.845136
[391]	validation_0-auc:0.881199	validation_1-auc:0.845101
[392]	validation_0-auc:0.881233	validation_1-auc:0.845102
[393]	validation_0-auc:0.881262	validation_1-auc:0.845106
[394]	validation_0-auc:0.881307	validation_1-auc:0.845104
[395]	validation_0-auc:0.881341	validation_1-auc:0.845109
[396]	validation_0-auc:0.881358	validation_1-auc:0.845089
[397]	validation_0-auc:0.881391	validation_1-auc:0.845132
[398]	validation_0-auc:0.881418	validation_1-auc:0.845094
[399]	validation_0-auc:0.881505	validation_1-auc:0.845038
[400]	validation_0-auc:0.881555	validation_1-auc:0.845018
[401]	validation_0-auc:0.881613	validation_1-auc:0.845076
[402]	validation_0-auc:0.881673	validation_1-auc:0.845118
[403]	validation_0-auc:0.881729	validation_1-auc:0.845085
[404]	validation_0-auc:0.88174	validation_1-auc:0.845081
[405]	validation_0-auc:0.881758	validation_1-auc:0.845064
[406]	validation_0-auc:0.881838	validation_1-auc:0.845054
[407]	validation_0-auc:0.881887	validation_1-auc:0.845125
[408]	validation_0-auc:0.881908	validation_1-auc:0.845144
[409]	validation_0-auc:0.881933	validation_1-auc:0.845201
[410]	validation_0-auc:0.881967	validation_1-auc:0.84523
[411]	validation_0-auc:0.882012	validation_1-auc:0.845258
[412]	validation_0-auc:0.882091	validation_1-auc:0.845238
[413]	validation_0-auc:0.882177	validation_1-auc:0.845216
[414]	validation_0-auc:0.882251	validation_1-auc:0.845152
[415]	validation_0-auc:0.882349	validation_1-auc:0.845158
[416]	validation_0-auc:0.882396	validation_1-auc:0.845162
[417]	validation_0-auc:0.882459	validation_1-auc:0.845112
[418]	validation_0-auc:0.882501	validation_1-auc:0.845113
[419]	validation_0-auc:0.882518	validation_1-auc:0.845118
[420]	validation_0-auc:0.882583	validation_1-auc:0.845135
[421]	validation_0-auc:0.882669	validation_1-auc:0.845103
[422]	validation_0-auc:0.88269	validation_1-auc:0.845049
[423]	validation_0-auc:0.882766	validation_1-auc:0.845036
[424]	validation_0-auc:0.882827	validation_1-auc:0.845022
[425]	validation_0-auc:0.882883	validation_1-auc:0.844995
[426]	validation_0-auc:0.882901	validation_1-auc:0.844984
[427]	validation_0-auc:0.882927	validation_1-auc:0.844986
[428]	validation_0-auc:0.882944	validation_1-auc:0.844985
[429]	validation_0-auc:0.882958	validation_1-auc:0.844984
[430]	validation_0-auc:0.883032	validation_1-auc:0.844986
[431]	validation_0-auc:0.883108	validation_1-auc:0.84496
[432]	validation_0-auc:0.883191	validation_1-auc:0.844956
[433]	validation_0-auc:0.883251	validation_1-auc:0.844924
[434]	validation_0-auc:0.883282	validation_1-auc:0.84494
[435]	validation_0-auc:0.883342	validation_1-auc:0.844861
[436]	validation_0-auc:0.883432	validation_1-auc:0.844854
[437]	validation_0-auc:0.883494	validation_1-auc:0.844822
[438]	validation_0-auc:0.883526	validation_1-auc:0.844807
[439]	validation_0-auc:0.883568	validation_1-auc:0.844766
[440]	validation_0-auc:0.883648	validation_1-auc:0.844744
[441]	validation_0-auc:0.883666	validation_1-auc:0.844724
[442]	validation_0-auc:0.88376	validation_1-auc:0.84474
[443]	validation_0-auc:0.883788	validation_1-auc:0.844741
[444]	validation_0-auc:0.88388	validation_1-auc:0.844748
[445]	validation_0-auc:0.883894	validation_1-auc:0.844742
[446]	validation_0-auc:0.883932	validation_1-auc:0.844772
[447]	validation_0-auc:0.884001	validation_1-auc:0.844766
[448]	validation_0-auc:0.884072	validation_1-auc:0.844778
[449]	validation_0-auc:0.884092	validation_1-auc:0.844792
[450]	validation_0-auc:0.884099	validation_1-auc:0.844767
[451]	validation_0-auc:0.884119	validation_1-auc:0.844777
[452]	validation_0-auc:0.88421	validation_1-auc:0.844759
[453]	validation_0-auc:0.884233	validation_1-auc:0.844765
[454]	validation_0-auc:0.884276	validation_1-auc:0.844753
[455]	validation_0-auc:0.884331	validation_1-auc:0.844787
[456]	validation_0-auc:0.884342	validation_1-auc:0.844801
[457]	validation_0-auc:0.884368	validation_1-auc:0.8448
[458]	validation_0-auc:0.884428	validation_1-auc:0.844796
[459]	validation_0-auc:0.884455	validation_1-auc:0.84481
[460]	validation_0-auc:0.884539	validation_1-auc:0.84484
[461]	validation_0-auc:0.88456	validation_1-auc:0.844857
[462]	validation_0-auc:0.884564	validation_1-auc:0.844849
[463]	validation_0-auc:0.884642	validation_1-auc:0.844822
[464]	validation_0-auc:0.884669	validation_1-auc:0.844828
[465]	validation_0-auc:0.884699	validation_1-auc:0.844847
[466]	validation_0-auc:0.884722	validation_1-auc:0.844823
[467]	validation_0-auc:0.884743	validation_1-auc:0.844816
[468]	validation_0-auc:0.884816	validation_1-auc:0.844835
[469]	validation_0-auc:0.884907	validation_1-auc:0.844836
[470]	validation_0-auc:0.88494	validation_1-auc:0.844843
[471]	validation_0-auc:0.88496	validation_1-auc:0.844837
[472]	validation_0-auc:0.884975	validation_1-auc:0.844841
[473]	validation_0-auc:0.885058	validation_1-auc:0.844792
[474]	validation_0-auc:0.88507	validation_1-auc:0.844778
[475]	validation_0-auc:0.885086	validation_1-auc:0.844752
[476]	validation_0-auc:0.885177	validation_1-auc:0.84474
[477]	validation_0-auc:0.885259	validation_1-auc:0.844756
[478]	validation_0-auc:0.88531	validation_1-auc:0.844747
[479]	validation_0-auc:0.885389	validation_1-auc:0.844757
[480]	validation_0-auc:0.885404	validation_1-auc:0.844772
[481]	validation_0-auc:0.885421	validation_1-auc:0.844767
[482]	validation_0-auc:0.885434	validation_1-auc:0.844753
[483]	validation_0-auc:0.885475	validation_1-auc:0.844763
[484]	validation_0-auc:0.885553	validation_1-auc:0.844775
[485]	validation_0-auc:0.885602	validation_1-auc:0.844731
[486]	validation_0-auc:0.885674	validation_1-auc:0.844793
[487]	validation_0-auc:0.885702	validation_1-auc:0.844782
[488]	validation_0-auc:0.885759	validation_1-auc:0.844807
[489]	validation_0-auc:0.885794	validation_1-auc:0.844805
[490]	validation_0-auc:0.885828	validation_1-auc:0.844786
[491]	validation_0-auc:0.885867	validation_1-auc:0.844778
[492]	validation_0-auc:0.885886	validation_1-auc:0.844781
[493]	validation_0-auc:0.88591	validation_1-auc:0.844761
[494]	validation_0-auc:0.88594	validation_1-auc:0.844761
[495]	validation_0-auc:0.886036	validation_1-auc:0.844798
[496]	validation_0-auc:0.886091	validation_1-auc:0.84478
[497]	validation_0-auc:0.886183	validation_1-auc:0.844735
[498]	validation_0-auc:0.886224	validation_1-auc:0.844692
[499]	validation_0-auc:0.886258	validation_1-auc:0.844691
[500]	validation_0-auc:0.886312	validation_1-auc:0.844704
[501]	validation_0-auc:0.886366	validation_1-auc:0.844707
[502]	validation_0-auc:0.886424	validation_1-auc:0.844691
[503]	validation_0-auc:0.886516	validation_1-auc:0.844703
[504]	validation_0-auc:0.886575	validation_1-auc:0.844688
[505]	validation_0-auc:0.886607	validation_1-auc:0.844689
[506]	validation_0-auc:0.886665	validation_1-auc:0.844678
[507]	validation_0-auc:0.886707	validation_1-auc:0.844709
[508]	validation_0-auc:0.886728	validation_1-auc:0.844715
[509]	validation_0-auc:0.886751	validation_1-auc:0.844739
[510]	validation_0-auc:0.886785	validation_1-auc:0.844752
[511]	validation_0-auc:0.886825	validation_1-auc:0.844771
[512]	validation_0-auc:0.886845	validation_1-auc:0.844755
[513]	validation_0-auc:0.886866	validation_1-auc:0.844728
[514]	validation_0-auc:0.886874	validation_1-auc:0.844711
[515]	validation_0-auc:0.886901	validation_1-auc:0.844693
[516]	validation_0-auc:0.886983	validation_1-auc:0.84473
[517]	validation_0-auc:0.887016	validation_1-auc:0.844734
[518]	validation_0-auc:0.887051	validation_1-auc:0.844713
[519]	validation_0-auc:0.887085	validation_1-auc:0.844731
[520]	validation_0-auc:0.887147	validation_1-auc:0.844732
[521]	validation_0-auc:0.88717	validation_1-auc:0.844743
[522]	validation_0-auc:0.887206	validation_1-auc:0.844752
Stopping. Best iteration:
[322]	validation_0-auc:0.875799	validation_1-auc:0.845917

ROC AUC: 0.8459

In [18]:

# 튜닝된 모렏에서 각 피처의 중요도를 피처 중요도 그래프로 표현

from xgboost import plot_importance
import matplotlib.pyplot as plt
%matplotlib inline

fig, ax = plt.subplots(1,1,figsize=(10,8))
plot_importance(xgb_clf, ax=ax , max_num_features=20,height=0.4)

Out[18]:

<matplotlib.axes._subplots.AxesSubplot at 0x7feefcc1cac8>

In [19]:

"""
LightGBM 모델 학습과 하이퍼 파라미터 튜닝
n_estimators = 500
early_stopping_rounds = 100
eval_metric(성능 평가 기준) = ROC-AUC
평가 데이터 세트 = 위에서 분리한 테스트 데이터 세트
eval_set = [(X_train, y_train), (X_test, y_test)]
"""


from lightgbm import LGBMClassifier

lgbm_clf = LGBMClassifier(n_estimators=500)

evals = [(X_test, y_test)]
lgbm_clf.fit(X_train, y_train, early_stopping_rounds=100, eval_metric="auc", eval_set=evals,
                verbose=True)

lgbm_roc_score = roc_auc_score(y_test, lgbm_clf.predict_proba(X_test)[:,1],average='macro')
print('ROC AUC: {0:.4f}'.format(lgbm_roc_score))

[1]	valid_0's binary_logloss: 0.165046	valid_0's auc: 0.817384
Training until validation scores don't improve for 100 rounds.
[2]	valid_0's binary_logloss: 0.16	valid_0's auc: 0.81863
[3]	valid_0's binary_logloss: 0.156287	valid_0's auc: 0.827411
[4]	valid_0's binary_logloss: 0.153416	valid_0's auc: 0.832175
[5]	valid_0's binary_logloss: 0.151206	valid_0's auc: 0.83481
[6]	valid_0's binary_logloss: 0.149303	valid_0's auc: 0.834721
[7]	valid_0's binary_logloss: 0.147804	valid_0's auc: 0.83659
[8]	valid_0's binary_logloss: 0.146466	valid_0's auc: 0.837602
[9]	valid_0's binary_logloss: 0.145476	valid_0's auc: 0.838114
[10]	valid_0's binary_logloss: 0.144681	valid_0's auc: 0.838472
[11]	valid_0's binary_logloss: 0.143978	valid_0's auc: 0.83808
[12]	valid_0's binary_logloss: 0.14341	valid_0's auc: 0.837771
[13]	valid_0's binary_logloss: 0.142835	valid_0's auc: 0.838063
[14]	valid_0's binary_logloss: 0.142296	valid_0's auc: 0.838485
[15]	valid_0's binary_logloss: 0.141903	valid_0's auc: 0.838542
[16]	valid_0's binary_logloss: 0.14162	valid_0's auc: 0.838275
[17]	valid_0's binary_logloss: 0.141252	valid_0's auc: 0.838817
[18]	valid_0's binary_logloss: 0.14103	valid_0's auc: 0.838769
[19]	valid_0's binary_logloss: 0.140798	valid_0's auc: 0.83909
[20]	valid_0's binary_logloss: 0.140676	valid_0's auc: 0.838839
[21]	valid_0's binary_logloss: 0.140506	valid_0's auc: 0.838823
[22]	valid_0's binary_logloss: 0.140275	valid_0's auc: 0.838934
[23]	valid_0's binary_logloss: 0.140142	valid_0's auc: 0.838957
[24]	valid_0's binary_logloss: 0.140054	valid_0's auc: 0.838764
[25]	valid_0's binary_logloss: 0.140042	valid_0's auc: 0.838176
[26]	valid_0's binary_logloss: 0.140012	valid_0's auc: 0.838068
[27]	valid_0's binary_logloss: 0.139937	valid_0's auc: 0.83824
[28]	valid_0's binary_logloss: 0.139844	valid_0's auc: 0.838487
[29]	valid_0's binary_logloss: 0.139726	valid_0's auc: 0.839041
[30]	valid_0's binary_logloss: 0.139708	valid_0's auc: 0.83871
[31]	valid_0's binary_logloss: 0.139745	valid_0's auc: 0.838192
[32]	valid_0's binary_logloss: 0.139679	valid_0's auc: 0.838453
[33]	valid_0's binary_logloss: 0.139702	valid_0's auc: 0.838265
[34]	valid_0's binary_logloss: 0.139697	valid_0's auc: 0.83818
[35]	valid_0's binary_logloss: 0.139697	valid_0's auc: 0.838186
[36]	valid_0's binary_logloss: 0.139716	valid_0's auc: 0.837934
[37]	valid_0's binary_logloss: 0.139622	valid_0's auc: 0.838364
[38]	valid_0's binary_logloss: 0.139564	valid_0's auc: 0.838565
[39]	valid_0's binary_logloss: 0.139543	valid_0's auc: 0.838829
[40]	valid_0's binary_logloss: 0.139483	valid_0's auc: 0.83898
[41]	valid_0's binary_logloss: 0.139434	valid_0's auc: 0.839369
[42]	valid_0's binary_logloss: 0.139408	valid_0's auc: 0.839599
[43]	valid_0's binary_logloss: 0.139411	valid_0's auc: 0.839508
[44]	valid_0's binary_logloss: 0.139448	valid_0's auc: 0.839287
[45]	valid_0's binary_logloss: 0.139432	valid_0's auc: 0.839477
[46]	valid_0's binary_logloss: 0.139495	valid_0's auc: 0.839166
[47]	valid_0's binary_logloss: 0.139508	valid_0's auc: 0.838945
[48]	valid_0's binary_logloss: 0.139522	valid_0's auc: 0.838841
[49]	valid_0's binary_logloss: 0.139484	valid_0's auc: 0.838891
[50]	valid_0's binary_logloss: 0.139537	valid_0's auc: 0.838737
[51]	valid_0's binary_logloss: 0.139507	valid_0's auc: 0.8389
[52]	valid_0's binary_logloss: 0.139495	valid_0's auc: 0.838932
[53]	valid_0's binary_logloss: 0.139547	valid_0's auc: 0.838757
[54]	valid_0's binary_logloss: 0.139549	valid_0's auc: 0.838692
[55]	valid_0's binary_logloss: 0.139518	valid_0's auc: 0.838783
[56]	valid_0's binary_logloss: 0.139531	valid_0's auc: 0.838739
[57]	valid_0's binary_logloss: 0.139576	valid_0's auc: 0.838757
[58]	valid_0's binary_logloss: 0.139589	valid_0's auc: 0.838701
[59]	valid_0's binary_logloss: 0.139628	valid_0's auc: 0.838641
[60]	valid_0's binary_logloss: 0.139663	valid_0's auc: 0.838437
[61]	valid_0's binary_logloss: 0.139665	valid_0's auc: 0.838503
[62]	valid_0's binary_logloss: 0.139673	valid_0's auc: 0.838393
[63]	valid_0's binary_logloss: 0.139711	valid_0's auc: 0.838211
[64]	valid_0's binary_logloss: 0.139683	valid_0's auc: 0.838301
[65]	valid_0's binary_logloss: 0.139712	valid_0's auc: 0.837919
[66]	valid_0's binary_logloss: 0.139758	valid_0's auc: 0.837657
[67]	valid_0's binary_logloss: 0.139737	valid_0's auc: 0.837749
[68]	valid_0's binary_logloss: 0.13976	valid_0's auc: 0.837664
[69]	valid_0's binary_logloss: 0.139731	valid_0's auc: 0.837731
[70]	valid_0's binary_logloss: 0.139778	valid_0's auc: 0.837545
[71]	valid_0's binary_logloss: 0.139776	valid_0's auc: 0.837491
[72]	valid_0's binary_logloss: 0.139762	valid_0's auc: 0.83758
[73]	valid_0's binary_logloss: 0.13978	valid_0's auc: 0.837516
[74]	valid_0's binary_logloss: 0.13978	valid_0's auc: 0.837582
[75]	valid_0's binary_logloss: 0.13977	valid_0's auc: 0.83758
[76]	valid_0's binary_logloss: 0.139815	valid_0's auc: 0.837467
[77]	valid_0's binary_logloss: 0.139805	valid_0's auc: 0.837473
[78]	valid_0's binary_logloss: 0.139812	valid_0's auc: 0.837617
[79]	valid_0's binary_logloss: 0.139839	valid_0's auc: 0.837659
[80]	valid_0's binary_logloss: 0.139849	valid_0's auc: 0.837613
[81]	valid_0's binary_logloss: 0.139835	valid_0's auc: 0.837706
[82]	valid_0's binary_logloss: 0.139886	valid_0's auc: 0.837368
[83]	valid_0's binary_logloss: 0.13986	valid_0's auc: 0.837477
[84]	valid_0's binary_logloss: 0.13986	valid_0's auc: 0.837504
[85]	valid_0's binary_logloss: 0.13993	valid_0's auc: 0.837287
[86]	valid_0's binary_logloss: 0.139942	valid_0's auc: 0.837323
[87]	valid_0's binary_logloss: 0.139964	valid_0's auc: 0.837161
[88]	valid_0's binary_logloss: 0.140011	valid_0's auc: 0.836989
[89]	valid_0's binary_logloss: 0.140014	valid_0's auc: 0.837035
[90]	valid_0's binary_logloss: 0.140049	valid_0's auc: 0.837007
[91]	valid_0's binary_logloss: 0.140078	valid_0's auc: 0.836832
[92]	valid_0's binary_logloss: 0.14007	valid_0's auc: 0.836979
[93]	valid_0's binary_logloss: 0.140135	valid_0's auc: 0.836875
[94]	valid_0's binary_logloss: 0.140139	valid_0's auc: 0.836843
[95]	valid_0's binary_logloss: 0.140121	valid_0's auc: 0.836938
[96]	valid_0's binary_logloss: 0.14004	valid_0's auc: 0.837312
[97]	valid_0's binary_logloss: 0.140082	valid_0's auc: 0.837229
[98]	valid_0's binary_logloss: 0.140053	valid_0's auc: 0.837361
[99]	valid_0's binary_logloss: 0.140073	valid_0's auc: 0.837365
[100]	valid_0's binary_logloss: 0.140095	valid_0's auc: 0.837229
[101]	valid_0's binary_logloss: 0.14014	valid_0's auc: 0.837124
[102]	valid_0's binary_logloss: 0.140065	valid_0's auc: 0.837385
[103]	valid_0's binary_logloss: 0.139975	valid_0's auc: 0.837954
[104]	valid_0's binary_logloss: 0.140027	valid_0's auc: 0.83767
[105]	valid_0's binary_logloss: 0.140044	valid_0's auc: 0.837743
[106]	valid_0's binary_logloss: 0.140052	valid_0's auc: 0.837839
[107]	valid_0's binary_logloss: 0.140105	valid_0's auc: 0.8377
[108]	valid_0's binary_logloss: 0.140153	valid_0's auc: 0.837582
[109]	valid_0's binary_logloss: 0.140184	valid_0's auc: 0.837439
[110]	valid_0's binary_logloss: 0.140216	valid_0's auc: 0.83731
[111]	valid_0's binary_logloss: 0.140234	valid_0's auc: 0.837193
[112]	valid_0's binary_logloss: 0.140296	valid_0's auc: 0.836993
[113]	valid_0's binary_logloss: 0.140335	valid_0's auc: 0.836994
[114]	valid_0's binary_logloss: 0.140367	valid_0's auc: 0.836887
[115]	valid_0's binary_logloss: 0.140415	valid_0's auc: 0.836742
[116]	valid_0's binary_logloss: 0.140488	valid_0's auc: 0.836448
[117]	valid_0's binary_logloss: 0.140496	valid_0's auc: 0.836571
[118]	valid_0's binary_logloss: 0.140481	valid_0's auc: 0.836701
[119]	valid_0's binary_logloss: 0.140491	valid_0's auc: 0.836717
[120]	valid_0's binary_logloss: 0.140508	valid_0's auc: 0.836673
[121]	valid_0's binary_logloss: 0.14052	valid_0's auc: 0.836644
[122]	valid_0's binary_logloss: 0.140536	valid_0's auc: 0.836649
[123]	valid_0's binary_logloss: 0.140598	valid_0's auc: 0.836457
[124]	valid_0's binary_logloss: 0.140664	valid_0's auc: 0.836254
[125]	valid_0's binary_logloss: 0.140693	valid_0's auc: 0.836198
[126]	valid_0's binary_logloss: 0.140672	valid_0's auc: 0.836429
[127]	valid_0's binary_logloss: 0.14072	valid_0's auc: 0.836282
[128]	valid_0's binary_logloss: 0.140781	valid_0's auc: 0.836152
[129]	valid_0's binary_logloss: 0.140809	valid_0's auc: 0.836156
[130]	valid_0's binary_logloss: 0.140835	valid_0's auc: 0.83605
[131]	valid_0's binary_logloss: 0.140835	valid_0's auc: 0.836033
[132]	valid_0's binary_logloss: 0.140852	valid_0's auc: 0.836014
[133]	valid_0's binary_logloss: 0.1409	valid_0's auc: 0.835977
[134]	valid_0's binary_logloss: 0.140951	valid_0's auc: 0.835695
[135]	valid_0's binary_logloss: 0.140975	valid_0's auc: 0.835689
[136]	valid_0's binary_logloss: 0.141011	valid_0's auc: 0.83554
[137]	valid_0's binary_logloss: 0.141098	valid_0's auc: 0.835146
[138]	valid_0's binary_logloss: 0.141136	valid_0's auc: 0.83503
[139]	valid_0's binary_logloss: 0.141206	valid_0's auc: 0.834826
[140]	valid_0's binary_logloss: 0.141267	valid_0's auc: 0.834576
[141]	valid_0's binary_logloss: 0.141328	valid_0's auc: 0.834265
[142]	valid_0's binary_logloss: 0.141359	valid_0's auc: 0.8342
Early stopping, best iteration is:
[42]	valid_0's binary_logloss: 0.139408	valid_0's auc: 0.839599
ROC AUC: 0.8396

In [20]:

# ROC AUC: 0.8396
"""
하이퍼 파라미터 튜닝
num_leaves, max_depth, min_child_samples, subsample 만 튜닝
수행시간을 고려해 n_estimators=200, early_stopping_rounds=30 으로 설정 후 튜닝
"""

from sklearn.model_selection import GridSearchCV

# 하이퍼 파라미터 테스트의 수행 속도를 향상시키기 위해 n_estimators를 200으로 감소
LGBM_clf = LGBMClassifier(n_estimators=200)

params = {'num_leaves': [32, 64 ],
          'max_depth':[128, 160],
          'min_child_samples':[60, 100],
          'subsample':[0.8, 1]}


# 하이퍼 파라미터 테스트 
gridcv = GridSearchCV(lgbm_clf, param_grid=params, cv=3)
gridcv.fit(X_train, y_train, early_stopping_rounds=30, eval_metric="auc",
           eval_set=[(X_train, y_train), (X_test, y_test)])

print('GridSearchCV 최적 파라미터:', gridcv.best_params_)
lgbm_roc_score = roc_auc_score(y_test, gridcv.predict_proba(X_test)[:,1], average='macro')
print('ROC AUC: {0:.4f}'.format(lgbm_roc_score))

[1]	valid_0's binary_logloss: 0.156085	valid_0's auc: 0.820235	valid_1's binary_logloss: 0.164992	valid_1's auc: 0.81613
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150951	valid_0's auc: 0.825778	valid_1's binary_logloss: 0.159874	valid_1's auc: 0.821835
[3]	valid_0's binary_logloss: 0.147167	valid_0's auc: 0.832192	valid_1's binary_logloss: 0.156391	valid_1's auc: 0.827305
[4]	valid_0's binary_logloss: 0.144132	valid_0's auc: 0.837507	valid_1's binary_logloss: 0.15332	valid_1's auc: 0.8334
[5]	valid_0's binary_logloss: 0.141652	valid_0's auc: 0.842275	valid_1's binary_logloss: 0.150954	valid_1's auc: 0.836036
[6]	valid_0's binary_logloss: 0.139662	valid_0's auc: 0.844971	valid_1's binary_logloss: 0.149041	valid_1's auc: 0.838026
[7]	valid_0's binary_logloss: 0.138002	valid_0's auc: 0.846612	valid_1's binary_logloss: 0.147504	valid_1's auc: 0.837776
[8]	valid_0's binary_logloss: 0.136579	valid_0's auc: 0.848539	valid_1's binary_logloss: 0.14601	valid_1's auc: 0.839506
[9]	valid_0's binary_logloss: 0.135283	valid_0's auc: 0.850098	valid_1's binary_logloss: 0.144934	valid_1's auc: 0.84033
[10]	valid_0's binary_logloss: 0.134195	valid_0's auc: 0.852202	valid_1's binary_logloss: 0.144075	valid_1's auc: 0.840094
[11]	valid_0's binary_logloss: 0.133246	valid_0's auc: 0.853608	valid_1's binary_logloss: 0.143371	valid_1's auc: 0.839532
[12]	valid_0's binary_logloss: 0.132408	valid_0's auc: 0.854898	valid_1's binary_logloss: 0.142828	valid_1's auc: 0.838961
[13]	valid_0's binary_logloss: 0.131678	valid_0's auc: 0.855877	valid_1's binary_logloss: 0.142265	valid_1's auc: 0.839079
[14]	valid_0's binary_logloss: 0.130972	valid_0's auc: 0.857256	valid_1's binary_logloss: 0.14192	valid_1's auc: 0.838458
[15]	valid_0's binary_logloss: 0.130365	valid_0's auc: 0.85849	valid_1's binary_logloss: 0.141638	valid_1's auc: 0.837837
[16]	valid_0's binary_logloss: 0.129795	valid_0's auc: 0.859518	valid_1's binary_logloss: 0.141266	valid_1's auc: 0.837919
[17]	valid_0's binary_logloss: 0.129246	valid_0's auc: 0.86107	valid_1's binary_logloss: 0.141008	valid_1's auc: 0.837675
[18]	valid_0's binary_logloss: 0.128764	valid_0's auc: 0.862382	valid_1's binary_logloss: 0.140844	valid_1's auc: 0.83754
[19]	valid_0's binary_logloss: 0.128294	valid_0's auc: 0.86341	valid_1's binary_logloss: 0.140732	valid_1's auc: 0.836495
[20]	valid_0's binary_logloss: 0.127851	valid_0's auc: 0.864532	valid_1's binary_logloss: 0.140651	valid_1's auc: 0.835573
[21]	valid_0's binary_logloss: 0.127401	valid_0's auc: 0.865793	valid_1's binary_logloss: 0.140562	valid_1's auc: 0.835214
[22]	valid_0's binary_logloss: 0.127031	valid_0's auc: 0.866613	valid_1's binary_logloss: 0.14041	valid_1's auc: 0.834961
[23]	valid_0's binary_logloss: 0.126618	valid_0's auc: 0.867953	valid_1's binary_logloss: 0.140264	valid_1's auc: 0.835354
[24]	valid_0's binary_logloss: 0.126294	valid_0's auc: 0.868421	valid_1's binary_logloss: 0.140261	valid_1's auc: 0.834851
[25]	valid_0's binary_logloss: 0.12595	valid_0's auc: 0.869239	valid_1's binary_logloss: 0.140297	valid_1's auc: 0.834303
[26]	valid_0's binary_logloss: 0.125634	valid_0's auc: 0.869717	valid_1's binary_logloss: 0.140258	valid_1's auc: 0.833989
[27]	valid_0's binary_logloss: 0.125306	valid_0's auc: 0.871105	valid_1's binary_logloss: 0.140221	valid_1's auc: 0.834075
[28]	valid_0's binary_logloss: 0.125006	valid_0's auc: 0.871842	valid_1's binary_logloss: 0.140204	valid_1's auc: 0.833809
[29]	valid_0's binary_logloss: 0.124667	valid_0's auc: 0.872834	valid_1's binary_logloss: 0.140234	valid_1's auc: 0.833672
[30]	valid_0's binary_logloss: 0.124428	valid_0's auc: 0.873209	valid_1's binary_logloss: 0.140246	valid_1's auc: 0.833228
[31]	valid_0's binary_logloss: 0.124154	valid_0's auc: 0.873779	valid_1's binary_logloss: 0.140196	valid_1's auc: 0.833437
[32]	valid_0's binary_logloss: 0.123793	valid_0's auc: 0.875169	valid_1's binary_logloss: 0.140131	valid_1's auc: 0.833543
[33]	valid_0's binary_logloss: 0.123538	valid_0's auc: 0.875945	valid_1's binary_logloss: 0.140074	valid_1's auc: 0.833771
[34]	valid_0's binary_logloss: 0.123273	valid_0's auc: 0.876838	valid_1's binary_logloss: 0.140029	valid_1's auc: 0.834188
[35]	valid_0's binary_logloss: 0.123033	valid_0's auc: 0.877285	valid_1's binary_logloss: 0.140083	valid_1's auc: 0.833868
[36]	valid_0's binary_logloss: 0.122827	valid_0's auc: 0.877822	valid_1's binary_logloss: 0.140161	valid_1's auc: 0.833427
[37]	valid_0's binary_logloss: 0.122582	valid_0's auc: 0.87835	valid_1's binary_logloss: 0.140133	valid_1's auc: 0.833781
[38]	valid_0's binary_logloss: 0.122378	valid_0's auc: 0.878728	valid_1's binary_logloss: 0.140119	valid_1's auc: 0.833827
[39]	valid_0's binary_logloss: 0.122177	valid_0's auc: 0.879195	valid_1's binary_logloss: 0.140111	valid_1's auc: 0.833696
Early stopping, best iteration is:
[9]	valid_0's binary_logloss: 0.135283	valid_0's auc: 0.850098	valid_1's binary_logloss: 0.144934	valid_1's auc: 0.84033
[1]	valid_0's binary_logloss: 0.156452	valid_0's auc: 0.814371	valid_1's binary_logloss: 0.165418	valid_1's auc: 0.813175
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151081	valid_0's auc: 0.827202	valid_1's binary_logloss: 0.160086	valid_1's auc: 0.819989
[3]	valid_0's binary_logloss: 0.147219	valid_0's auc: 0.836893	valid_1's binary_logloss: 0.156403	valid_1's auc: 0.828833
[4]	valid_0's binary_logloss: 0.144211	valid_0's auc: 0.841451	valid_1's binary_logloss: 0.153547	valid_1's auc: 0.830881
[5]	valid_0's binary_logloss: 0.141696	valid_0's auc: 0.843957	valid_1's binary_logloss: 0.151227	valid_1's auc: 0.832819
[6]	valid_0's binary_logloss: 0.139678	valid_0's auc: 0.847748	valid_1's binary_logloss: 0.149329	valid_1's auc: 0.836614
[7]	valid_0's binary_logloss: 0.137985	valid_0's auc: 0.849327	valid_1's binary_logloss: 0.147839	valid_1's auc: 0.836739
[8]	valid_0's binary_logloss: 0.136536	valid_0's auc: 0.850907	valid_1's binary_logloss: 0.146655	valid_1's auc: 0.836711
[9]	valid_0's binary_logloss: 0.135271	valid_0's auc: 0.85358	valid_1's binary_logloss: 0.145525	valid_1's auc: 0.838258
[10]	valid_0's binary_logloss: 0.134171	valid_0's auc: 0.854862	valid_1's binary_logloss: 0.144605	valid_1's auc: 0.837503
[11]	valid_0's binary_logloss: 0.133185	valid_0's auc: 0.856107	valid_1's binary_logloss: 0.143788	valid_1's auc: 0.837895
[12]	valid_0's binary_logloss: 0.132348	valid_0's auc: 0.857143	valid_1's binary_logloss: 0.143194	valid_1's auc: 0.837519
[13]	valid_0's binary_logloss: 0.131563	valid_0's auc: 0.858514	valid_1's binary_logloss: 0.142655	valid_1's auc: 0.837281
[14]	valid_0's binary_logloss: 0.130866	valid_0's auc: 0.859381	valid_1's binary_logloss: 0.142234	valid_1's auc: 0.836814
[15]	valid_0's binary_logloss: 0.130265	valid_0's auc: 0.860107	valid_1's binary_logloss: 0.141784	valid_1's auc: 0.837227
[16]	valid_0's binary_logloss: 0.129652	valid_0's auc: 0.861293	valid_1's binary_logloss: 0.141436	valid_1's auc: 0.837155
[17]	valid_0's binary_logloss: 0.129	valid_0's auc: 0.862801	valid_1's binary_logloss: 0.141233	valid_1's auc: 0.836554
[18]	valid_0's binary_logloss: 0.128456	valid_0's auc: 0.864095	valid_1's binary_logloss: 0.140968	valid_1's auc: 0.836466
[19]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.864873	valid_1's binary_logloss: 0.140684	valid_1's auc: 0.837462
[20]	valid_0's binary_logloss: 0.127475	valid_0's auc: 0.866514	valid_1's binary_logloss: 0.140492	valid_1's auc: 0.837791
[21]	valid_0's binary_logloss: 0.127019	valid_0's auc: 0.867526	valid_1's binary_logloss: 0.140352	valid_1's auc: 0.837515
[22]	valid_0's binary_logloss: 0.126586	valid_0's auc: 0.868522	valid_1's binary_logloss: 0.14027	valid_1's auc: 0.837105
[23]	valid_0's binary_logloss: 0.126176	valid_0's auc: 0.869624	valid_1's binary_logloss: 0.140097	valid_1's auc: 0.837722
[24]	valid_0's binary_logloss: 0.125766	valid_0's auc: 0.870398	valid_1's binary_logloss: 0.140002	valid_1's auc: 0.838042
[25]	valid_0's binary_logloss: 0.125436	valid_0's auc: 0.871071	valid_1's binary_logloss: 0.139982	valid_1's auc: 0.837726
[26]	valid_0's binary_logloss: 0.125096	valid_0's auc: 0.871873	valid_1's binary_logloss: 0.139903	valid_1's auc: 0.837516
[27]	valid_0's binary_logloss: 0.124766	valid_0's auc: 0.872747	valid_1's binary_logloss: 0.139873	valid_1's auc: 0.83744
[28]	valid_0's binary_logloss: 0.124448	valid_0's auc: 0.873243	valid_1's binary_logloss: 0.139828	valid_1's auc: 0.837467
[29]	valid_0's binary_logloss: 0.124164	valid_0's auc: 0.873959	valid_1's binary_logloss: 0.139781	valid_1's auc: 0.83751
[30]	valid_0's binary_logloss: 0.123934	valid_0's auc: 0.874666	valid_1's binary_logloss: 0.139667	valid_1's auc: 0.837891
[31]	valid_0's binary_logloss: 0.123703	valid_0's auc: 0.875615	valid_1's binary_logloss: 0.139545	valid_1's auc: 0.83861
[32]	valid_0's binary_logloss: 0.123475	valid_0's auc: 0.876151	valid_1's binary_logloss: 0.13945	valid_1's auc: 0.838762
[33]	valid_0's binary_logloss: 0.123248	valid_0's auc: 0.877026	valid_1's binary_logloss: 0.139439	valid_1's auc: 0.838799
[34]	valid_0's binary_logloss: 0.123057	valid_0's auc: 0.877606	valid_1's binary_logloss: 0.139447	valid_1's auc: 0.838511
[35]	valid_0's binary_logloss: 0.122861	valid_0's auc: 0.878266	valid_1's binary_logloss: 0.139413	valid_1's auc: 0.838604
[36]	valid_0's binary_logloss: 0.122635	valid_0's auc: 0.87885	valid_1's binary_logloss: 0.139347	valid_1's auc: 0.838919
[37]	valid_0's binary_logloss: 0.12236	valid_0's auc: 0.879609	valid_1's binary_logloss: 0.139342	valid_1's auc: 0.83891
[38]	valid_0's binary_logloss: 0.12211	valid_0's auc: 0.879941	valid_1's binary_logloss: 0.139438	valid_1's auc: 0.838586
[39]	valid_0's binary_logloss: 0.121864	valid_0's auc: 0.880723	valid_1's binary_logloss: 0.139421	valid_1's auc: 0.838655
[40]	valid_0's binary_logloss: 0.121708	valid_0's auc: 0.881052	valid_1's binary_logloss: 0.139358	valid_1's auc: 0.83903
[41]	valid_0's binary_logloss: 0.12146	valid_0's auc: 0.881719	valid_1's binary_logloss: 0.139353	valid_1's auc: 0.83903
[42]	valid_0's binary_logloss: 0.121168	valid_0's auc: 0.882841	valid_1's binary_logloss: 0.139266	valid_1's auc: 0.83955
[43]	valid_0's binary_logloss: 0.120936	valid_0's auc: 0.883416	valid_1's binary_logloss: 0.139368	valid_1's auc: 0.839046
[44]	valid_0's binary_logloss: 0.120707	valid_0's auc: 0.883946	valid_1's binary_logloss: 0.139372	valid_1's auc: 0.839079
[45]	valid_0's binary_logloss: 0.120517	valid_0's auc: 0.884413	valid_1's binary_logloss: 0.139355	valid_1's auc: 0.839058
[46]	valid_0's binary_logloss: 0.120366	valid_0's auc: 0.884779	valid_1's binary_logloss: 0.139393	valid_1's auc: 0.839074
[47]	valid_0's binary_logloss: 0.120167	valid_0's auc: 0.885151	valid_1's binary_logloss: 0.139448	valid_1's auc: 0.838763
[48]	valid_0's binary_logloss: 0.120017	valid_0's auc: 0.885423	valid_1's binary_logloss: 0.13953	valid_1's auc: 0.838439
[49]	valid_0's binary_logloss: 0.119829	valid_0's auc: 0.885803	valid_1's binary_logloss: 0.139561	valid_1's auc: 0.83829
[50]	valid_0's binary_logloss: 0.119647	valid_0's auc: 0.886174	valid_1's binary_logloss: 0.139549	valid_1's auc: 0.838535
[51]	valid_0's binary_logloss: 0.119508	valid_0's auc: 0.886427	valid_1's binary_logloss: 0.139591	valid_1's auc: 0.838257
[52]	valid_0's binary_logloss: 0.119359	valid_0's auc: 0.886951	valid_1's binary_logloss: 0.139563	valid_1's auc: 0.838568
[53]	valid_0's binary_logloss: 0.119176	valid_0's auc: 0.887355	valid_1's binary_logloss: 0.139628	valid_1's auc: 0.838543
[54]	valid_0's binary_logloss: 0.118981	valid_0's auc: 0.887921	valid_1's binary_logloss: 0.139624	valid_1's auc: 0.838756
[55]	valid_0's binary_logloss: 0.118841	valid_0's auc: 0.888212	valid_1's binary_logloss: 0.139629	valid_1's auc: 0.838784
[56]	valid_0's binary_logloss: 0.118658	valid_0's auc: 0.888594	valid_1's binary_logloss: 0.139663	valid_1's auc: 0.838629
[57]	valid_0's binary_logloss: 0.118515	valid_0's auc: 0.888819	valid_1's binary_logloss: 0.139621	valid_1's auc: 0.838717
[58]	valid_0's binary_logloss: 0.118357	valid_0's auc: 0.889162	valid_1's binary_logloss: 0.139688	valid_1's auc: 0.838462
[59]	valid_0's binary_logloss: 0.118197	valid_0's auc: 0.889806	valid_1's binary_logloss: 0.139725	valid_1's auc: 0.838289
[60]	valid_0's binary_logloss: 0.118088	valid_0's auc: 0.889976	valid_1's binary_logloss: 0.139761	valid_1's auc: 0.83829
[61]	valid_0's binary_logloss: 0.117943	valid_0's auc: 0.890299	valid_1's binary_logloss: 0.139821	valid_1's auc: 0.838077
[62]	valid_0's binary_logloss: 0.117814	valid_0's auc: 0.890524	valid_1's binary_logloss: 0.139809	valid_1's auc: 0.838161
[63]	valid_0's binary_logloss: 0.117695	valid_0's auc: 0.890741	valid_1's binary_logloss: 0.139891	valid_1's auc: 0.837883
[64]	valid_0's binary_logloss: 0.117563	valid_0's auc: 0.891078	valid_1's binary_logloss: 0.139952	valid_1's auc: 0.837654
[65]	valid_0's binary_logloss: 0.117396	valid_0's auc: 0.891298	valid_1's binary_logloss: 0.139936	valid_1's auc: 0.837908
[66]	valid_0's binary_logloss: 0.117294	valid_0's auc: 0.891444	valid_1's binary_logloss: 0.139968	valid_1's auc: 0.837798
[67]	valid_0's binary_logloss: 0.117199	valid_0's auc: 0.891558	valid_1's binary_logloss: 0.139951	valid_1's auc: 0.837884
[68]	valid_0's binary_logloss: 0.117047	valid_0's auc: 0.891842	valid_1's binary_logloss: 0.139964	valid_1's auc: 0.837726
[69]	valid_0's binary_logloss: 0.116905	valid_0's auc: 0.892333	valid_1's binary_logloss: 0.140006	valid_1's auc: 0.837619
[70]	valid_0's binary_logloss: 0.116695	valid_0's auc: 0.892833	valid_1's binary_logloss: 0.139965	valid_1's auc: 0.837858
[71]	valid_0's binary_logloss: 0.116607	valid_0's auc: 0.892846	valid_1's binary_logloss: 0.140063	valid_1's auc: 0.837642
[72]	valid_0's binary_logloss: 0.116525	valid_0's auc: 0.892948	valid_1's binary_logloss: 0.140129	valid_1's auc: 0.837423
Early stopping, best iteration is:
[42]	valid_0's binary_logloss: 0.121168	valid_0's auc: 0.882841	valid_1's binary_logloss: 0.139266	valid_1's auc: 0.83955
[1]	valid_0's binary_logloss: 0.156528	valid_0's auc: 0.821645	valid_1's binary_logloss: 0.165101	valid_1's auc: 0.81857
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151187	valid_0's auc: 0.827652	valid_1's binary_logloss: 0.160088	valid_1's auc: 0.82254
[3]	valid_0's binary_logloss: 0.147263	valid_0's auc: 0.836059	valid_1's binary_logloss: 0.156608	valid_1's auc: 0.828121
[4]	valid_0's binary_logloss: 0.144258	valid_0's auc: 0.840507	valid_1's binary_logloss: 0.153573	valid_1's auc: 0.831883
[5]	valid_0's binary_logloss: 0.141763	valid_0's auc: 0.841889	valid_1's binary_logloss: 0.151258	valid_1's auc: 0.834129
[6]	valid_0's binary_logloss: 0.139749	valid_0's auc: 0.84495	valid_1's binary_logloss: 0.149359	valid_1's auc: 0.835139
[7]	valid_0's binary_logloss: 0.138082	valid_0's auc: 0.845803	valid_1's binary_logloss: 0.147853	valid_1's auc: 0.834809
[8]	valid_0's binary_logloss: 0.136693	valid_0's auc: 0.847136	valid_1's binary_logloss: 0.146585	valid_1's auc: 0.836717
[9]	valid_0's binary_logloss: 0.135437	valid_0's auc: 0.849549	valid_1's binary_logloss: 0.145575	valid_1's auc: 0.837358
[10]	valid_0's binary_logloss: 0.134374	valid_0's auc: 0.850797	valid_1's binary_logloss: 0.144671	valid_1's auc: 0.83794
[11]	valid_0's binary_logloss: 0.133441	valid_0's auc: 0.85216	valid_1's binary_logloss: 0.143939	valid_1's auc: 0.83805
[12]	valid_0's binary_logloss: 0.132621	valid_0's auc: 0.854509	valid_1's binary_logloss: 0.143406	valid_1's auc: 0.838172
[13]	valid_0's binary_logloss: 0.131801	valid_0's auc: 0.856837	valid_1's binary_logloss: 0.142845	valid_1's auc: 0.838172
[14]	valid_0's binary_logloss: 0.131085	valid_0's auc: 0.858379	valid_1's binary_logloss: 0.142438	valid_1's auc: 0.838161
[15]	valid_0's binary_logloss: 0.130403	valid_0's auc: 0.859828	valid_1's binary_logloss: 0.142128	valid_1's auc: 0.837333
[16]	valid_0's binary_logloss: 0.129848	valid_0's auc: 0.861034	valid_1's binary_logloss: 0.141806	valid_1's auc: 0.836715
[17]	valid_0's binary_logloss: 0.129299	valid_0's auc: 0.861775	valid_1's binary_logloss: 0.141398	valid_1's auc: 0.837193
[18]	valid_0's binary_logloss: 0.128797	valid_0's auc: 0.862844	valid_1's binary_logloss: 0.141105	valid_1's auc: 0.837688
[19]	valid_0's binary_logloss: 0.128254	valid_0's auc: 0.864183	valid_1's binary_logloss: 0.1408	valid_1's auc: 0.838493
[20]	valid_0's binary_logloss: 0.127764	valid_0's auc: 0.865434	valid_1's binary_logloss: 0.140629	valid_1's auc: 0.83826
[21]	valid_0's binary_logloss: 0.127313	valid_0's auc: 0.866549	valid_1's binary_logloss: 0.140491	valid_1's auc: 0.83802
[22]	valid_0's binary_logloss: 0.126892	valid_0's auc: 0.867557	valid_1's binary_logloss: 0.140253	valid_1's auc: 0.838476
[23]	valid_0's binary_logloss: 0.126489	valid_0's auc: 0.868549	valid_1's binary_logloss: 0.14015	valid_1's auc: 0.838499
[24]	valid_0's binary_logloss: 0.126193	valid_0's auc: 0.869053	valid_1's binary_logloss: 0.139968	valid_1's auc: 0.83904
[25]	valid_0's binary_logloss: 0.12589	valid_0's auc: 0.869728	valid_1's binary_logloss: 0.139803	valid_1's auc: 0.839059
[26]	valid_0's binary_logloss: 0.125571	valid_0's auc: 0.870373	valid_1's binary_logloss: 0.139698	valid_1's auc: 0.839138
[27]	valid_0's binary_logloss: 0.125257	valid_0's auc: 0.871341	valid_1's binary_logloss: 0.139664	valid_1's auc: 0.838837
[28]	valid_0's binary_logloss: 0.124955	valid_0's auc: 0.872255	valid_1's binary_logloss: 0.139614	valid_1's auc: 0.838733
[29]	valid_0's binary_logloss: 0.124683	valid_0's auc: 0.872979	valid_1's binary_logloss: 0.139634	valid_1's auc: 0.838445
[30]	valid_0's binary_logloss: 0.12443	valid_0's auc: 0.873557	valid_1's binary_logloss: 0.139581	valid_1's auc: 0.838392
[31]	valid_0's binary_logloss: 0.124188	valid_0's auc: 0.874202	valid_1's binary_logloss: 0.139633	valid_1's auc: 0.837993
[32]	valid_0's binary_logloss: 0.123929	valid_0's auc: 0.874831	valid_1's binary_logloss: 0.139651	valid_1's auc: 0.837759
[33]	valid_0's binary_logloss: 0.123718	valid_0's auc: 0.87536	valid_1's binary_logloss: 0.139601	valid_1's auc: 0.838121
[34]	valid_0's binary_logloss: 0.123446	valid_0's auc: 0.876098	valid_1's binary_logloss: 0.13959	valid_1's auc: 0.838127
[35]	valid_0's binary_logloss: 0.123227	valid_0's auc: 0.876685	valid_1's binary_logloss: 0.139632	valid_1's auc: 0.837767
[36]	valid_0's binary_logloss: 0.122984	valid_0's auc: 0.877273	valid_1's binary_logloss: 0.139635	valid_1's auc: 0.837941
[37]	valid_0's binary_logloss: 0.12276	valid_0's auc: 0.877868	valid_1's binary_logloss: 0.139578	valid_1's auc: 0.83805
[38]	valid_0's binary_logloss: 0.122494	valid_0's auc: 0.878325	valid_1's binary_logloss: 0.139527	valid_1's auc: 0.83832
[39]	valid_0's binary_logloss: 0.122248	valid_0's auc: 0.878917	valid_1's binary_logloss: 0.139516	valid_1's auc: 0.838503
[40]	valid_0's binary_logloss: 0.122038	valid_0's auc: 0.879406	valid_1's binary_logloss: 0.139475	valid_1's auc: 0.838825
[41]	valid_0's binary_logloss: 0.121865	valid_0's auc: 0.87982	valid_1's binary_logloss: 0.139525	valid_1's auc: 0.838607
[42]	valid_0's binary_logloss: 0.121697	valid_0's auc: 0.880217	valid_1's binary_logloss: 0.139582	valid_1's auc: 0.838459
[43]	valid_0's binary_logloss: 0.121448	valid_0's auc: 0.881131	valid_1's binary_logloss: 0.139571	valid_1's auc: 0.838519
[44]	valid_0's binary_logloss: 0.121268	valid_0's auc: 0.881502	valid_1's binary_logloss: 0.13955	valid_1's auc: 0.838652
[45]	valid_0's binary_logloss: 0.121081	valid_0's auc: 0.881982	valid_1's binary_logloss: 0.139559	valid_1's auc: 0.83858
[46]	valid_0's binary_logloss: 0.120906	valid_0's auc: 0.88233	valid_1's binary_logloss: 0.139657	valid_1's auc: 0.838247
[47]	valid_0's binary_logloss: 0.120707	valid_0's auc: 0.882781	valid_1's binary_logloss: 0.139655	valid_1's auc: 0.838252
[48]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.882987	valid_1's binary_logloss: 0.13965	valid_1's auc: 0.838213
[49]	valid_0's binary_logloss: 0.120348	valid_0's auc: 0.883422	valid_1's binary_logloss: 0.139707	valid_1's auc: 0.838107
[50]	valid_0's binary_logloss: 0.120181	valid_0's auc: 0.883798	valid_1's binary_logloss: 0.139747	valid_1's auc: 0.838134
[51]	valid_0's binary_logloss: 0.11997	valid_0's auc: 0.884299	valid_1's binary_logloss: 0.139789	valid_1's auc: 0.837738
[52]	valid_0's binary_logloss: 0.119771	valid_0's auc: 0.884801	valid_1's binary_logloss: 0.139841	valid_1's auc: 0.837647
[53]	valid_0's binary_logloss: 0.119577	valid_0's auc: 0.885413	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.837395
[54]	valid_0's binary_logloss: 0.119342	valid_0's auc: 0.885952	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.837545
[55]	valid_0's binary_logloss: 0.119167	valid_0's auc: 0.886405	valid_1's binary_logloss: 0.139935	valid_1's auc: 0.837432
[56]	valid_0's binary_logloss: 0.119038	valid_0's auc: 0.886617	valid_1's binary_logloss: 0.14002	valid_1's auc: 0.83708
Early stopping, best iteration is:
[26]	valid_0's binary_logloss: 0.125571	valid_0's auc: 0.870373	valid_1's binary_logloss: 0.139698	valid_1's auc: 0.839138
[1]	valid_0's binary_logloss: 0.156085	valid_0's auc: 0.820235	valid_1's binary_logloss: 0.164992	valid_1's auc: 0.81613
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150951	valid_0's auc: 0.825778	valid_1's binary_logloss: 0.159874	valid_1's auc: 0.821835
[3]	valid_0's binary_logloss: 0.147167	valid_0's auc: 0.832192	valid_1's binary_logloss: 0.156391	valid_1's auc: 0.827305
[4]	valid_0's binary_logloss: 0.144132	valid_0's auc: 0.837507	valid_1's binary_logloss: 0.15332	valid_1's auc: 0.8334
[5]	valid_0's binary_logloss: 0.141652	valid_0's auc: 0.842275	valid_1's binary_logloss: 0.150954	valid_1's auc: 0.836036
[6]	valid_0's binary_logloss: 0.139662	valid_0's auc: 0.844971	valid_1's binary_logloss: 0.149041	valid_1's auc: 0.838026
[7]	valid_0's binary_logloss: 0.138002	valid_0's auc: 0.846612	valid_1's binary_logloss: 0.147504	valid_1's auc: 0.837776
[8]	valid_0's binary_logloss: 0.136579	valid_0's auc: 0.848539	valid_1's binary_logloss: 0.14601	valid_1's auc: 0.839506
[9]	valid_0's binary_logloss: 0.135283	valid_0's auc: 0.850098	valid_1's binary_logloss: 0.144934	valid_1's auc: 0.84033
[10]	valid_0's binary_logloss: 0.134195	valid_0's auc: 0.852202	valid_1's binary_logloss: 0.144075	valid_1's auc: 0.840094
[11]	valid_0's binary_logloss: 0.133246	valid_0's auc: 0.853608	valid_1's binary_logloss: 0.143371	valid_1's auc: 0.839532
[12]	valid_0's binary_logloss: 0.132408	valid_0's auc: 0.854898	valid_1's binary_logloss: 0.142828	valid_1's auc: 0.838961
[13]	valid_0's binary_logloss: 0.131678	valid_0's auc: 0.855877	valid_1's binary_logloss: 0.142265	valid_1's auc: 0.839079
[14]	valid_0's binary_logloss: 0.130972	valid_0's auc: 0.857256	valid_1's binary_logloss: 0.14192	valid_1's auc: 0.838458
[15]	valid_0's binary_logloss: 0.130365	valid_0's auc: 0.85849	valid_1's binary_logloss: 0.141638	valid_1's auc: 0.837837
[16]	valid_0's binary_logloss: 0.129795	valid_0's auc: 0.859518	valid_1's binary_logloss: 0.141266	valid_1's auc: 0.837919
[17]	valid_0's binary_logloss: 0.129246	valid_0's auc: 0.86107	valid_1's binary_logloss: 0.141008	valid_1's auc: 0.837675
[18]	valid_0's binary_logloss: 0.128764	valid_0's auc: 0.862382	valid_1's binary_logloss: 0.140844	valid_1's auc: 0.83754
[19]	valid_0's binary_logloss: 0.128294	valid_0's auc: 0.86341	valid_1's binary_logloss: 0.140732	valid_1's auc: 0.836495
[20]	valid_0's binary_logloss: 0.127851	valid_0's auc: 0.864532	valid_1's binary_logloss: 0.140651	valid_1's auc: 0.835573
[21]	valid_0's binary_logloss: 0.127401	valid_0's auc: 0.865793	valid_1's binary_logloss: 0.140562	valid_1's auc: 0.835214
[22]	valid_0's binary_logloss: 0.127031	valid_0's auc: 0.866613	valid_1's binary_logloss: 0.14041	valid_1's auc: 0.834961
[23]	valid_0's binary_logloss: 0.126618	valid_0's auc: 0.867953	valid_1's binary_logloss: 0.140264	valid_1's auc: 0.835354
[24]	valid_0's binary_logloss: 0.126294	valid_0's auc: 0.868421	valid_1's binary_logloss: 0.140261	valid_1's auc: 0.834851
[25]	valid_0's binary_logloss: 0.12595	valid_0's auc: 0.869239	valid_1's binary_logloss: 0.140297	valid_1's auc: 0.834303
[26]	valid_0's binary_logloss: 0.125634	valid_0's auc: 0.869717	valid_1's binary_logloss: 0.140258	valid_1's auc: 0.833989
[27]	valid_0's binary_logloss: 0.125306	valid_0's auc: 0.871105	valid_1's binary_logloss: 0.140221	valid_1's auc: 0.834075
[28]	valid_0's binary_logloss: 0.125006	valid_0's auc: 0.871842	valid_1's binary_logloss: 0.140204	valid_1's auc: 0.833809
[29]	valid_0's binary_logloss: 0.124667	valid_0's auc: 0.872834	valid_1's binary_logloss: 0.140234	valid_1's auc: 0.833672
[30]	valid_0's binary_logloss: 0.124428	valid_0's auc: 0.873209	valid_1's binary_logloss: 0.140246	valid_1's auc: 0.833228
[31]	valid_0's binary_logloss: 0.124154	valid_0's auc: 0.873779	valid_1's binary_logloss: 0.140196	valid_1's auc: 0.833437
[32]	valid_0's binary_logloss: 0.123793	valid_0's auc: 0.875169	valid_1's binary_logloss: 0.140131	valid_1's auc: 0.833543
[33]	valid_0's binary_logloss: 0.123538	valid_0's auc: 0.875945	valid_1's binary_logloss: 0.140074	valid_1's auc: 0.833771
[34]	valid_0's binary_logloss: 0.123273	valid_0's auc: 0.876838	valid_1's binary_logloss: 0.140029	valid_1's auc: 0.834188
[35]	valid_0's binary_logloss: 0.123033	valid_0's auc: 0.877285	valid_1's binary_logloss: 0.140083	valid_1's auc: 0.833868
[36]	valid_0's binary_logloss: 0.122827	valid_0's auc: 0.877822	valid_1's binary_logloss: 0.140161	valid_1's auc: 0.833427
[37]	valid_0's binary_logloss: 0.122582	valid_0's auc: 0.87835	valid_1's binary_logloss: 0.140133	valid_1's auc: 0.833781
[38]	valid_0's binary_logloss: 0.122378	valid_0's auc: 0.878728	valid_1's binary_logloss: 0.140119	valid_1's auc: 0.833827
[39]	valid_0's binary_logloss: 0.122177	valid_0's auc: 0.879195	valid_1's binary_logloss: 0.140111	valid_1's auc: 0.833696
Early stopping, best iteration is:
[9]	valid_0's binary_logloss: 0.135283	valid_0's auc: 0.850098	valid_1's binary_logloss: 0.144934	valid_1's auc: 0.84033
[1]	valid_0's binary_logloss: 0.156452	valid_0's auc: 0.814371	valid_1's binary_logloss: 0.165418	valid_1's auc: 0.813175
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151081	valid_0's auc: 0.827202	valid_1's binary_logloss: 0.160086	valid_1's auc: 0.819989
[3]	valid_0's binary_logloss: 0.147219	valid_0's auc: 0.836893	valid_1's binary_logloss: 0.156403	valid_1's auc: 0.828833
[4]	valid_0's binary_logloss: 0.144211	valid_0's auc: 0.841451	valid_1's binary_logloss: 0.153547	valid_1's auc: 0.830881
[5]	valid_0's binary_logloss: 0.141696	valid_0's auc: 0.843957	valid_1's binary_logloss: 0.151227	valid_1's auc: 0.832819
[6]	valid_0's binary_logloss: 0.139678	valid_0's auc: 0.847748	valid_1's binary_logloss: 0.149329	valid_1's auc: 0.836614
[7]	valid_0's binary_logloss: 0.137985	valid_0's auc: 0.849327	valid_1's binary_logloss: 0.147839	valid_1's auc: 0.836739
[8]	valid_0's binary_logloss: 0.136536	valid_0's auc: 0.850907	valid_1's binary_logloss: 0.146655	valid_1's auc: 0.836711
[9]	valid_0's binary_logloss: 0.135271	valid_0's auc: 0.85358	valid_1's binary_logloss: 0.145525	valid_1's auc: 0.838258
[10]	valid_0's binary_logloss: 0.134171	valid_0's auc: 0.854862	valid_1's binary_logloss: 0.144605	valid_1's auc: 0.837503
[11]	valid_0's binary_logloss: 0.133185	valid_0's auc: 0.856107	valid_1's binary_logloss: 0.143788	valid_1's auc: 0.837895
[12]	valid_0's binary_logloss: 0.132348	valid_0's auc: 0.857143	valid_1's binary_logloss: 0.143194	valid_1's auc: 0.837519
[13]	valid_0's binary_logloss: 0.131563	valid_0's auc: 0.858514	valid_1's binary_logloss: 0.142655	valid_1's auc: 0.837281
[14]	valid_0's binary_logloss: 0.130866	valid_0's auc: 0.859381	valid_1's binary_logloss: 0.142234	valid_1's auc: 0.836814
[15]	valid_0's binary_logloss: 0.130265	valid_0's auc: 0.860107	valid_1's binary_logloss: 0.141784	valid_1's auc: 0.837227
[16]	valid_0's binary_logloss: 0.129652	valid_0's auc: 0.861293	valid_1's binary_logloss: 0.141436	valid_1's auc: 0.837155
[17]	valid_0's binary_logloss: 0.129	valid_0's auc: 0.862801	valid_1's binary_logloss: 0.141233	valid_1's auc: 0.836554
[18]	valid_0's binary_logloss: 0.128456	valid_0's auc: 0.864095	valid_1's binary_logloss: 0.140968	valid_1's auc: 0.836466
[19]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.864873	valid_1's binary_logloss: 0.140684	valid_1's auc: 0.837462
[20]	valid_0's binary_logloss: 0.127475	valid_0's auc: 0.866514	valid_1's binary_logloss: 0.140492	valid_1's auc: 0.837791
[21]	valid_0's binary_logloss: 0.127019	valid_0's auc: 0.867526	valid_1's binary_logloss: 0.140352	valid_1's auc: 0.837515
[22]	valid_0's binary_logloss: 0.126586	valid_0's auc: 0.868522	valid_1's binary_logloss: 0.14027	valid_1's auc: 0.837105
[23]	valid_0's binary_logloss: 0.126176	valid_0's auc: 0.869624	valid_1's binary_logloss: 0.140097	valid_1's auc: 0.837722
[24]	valid_0's binary_logloss: 0.125766	valid_0's auc: 0.870398	valid_1's binary_logloss: 0.140002	valid_1's auc: 0.838042
[25]	valid_0's binary_logloss: 0.125436	valid_0's auc: 0.871071	valid_1's binary_logloss: 0.139982	valid_1's auc: 0.837726
[26]	valid_0's binary_logloss: 0.125096	valid_0's auc: 0.871873	valid_1's binary_logloss: 0.139903	valid_1's auc: 0.837516
[27]	valid_0's binary_logloss: 0.124766	valid_0's auc: 0.872747	valid_1's binary_logloss: 0.139873	valid_1's auc: 0.83744
[28]	valid_0's binary_logloss: 0.124448	valid_0's auc: 0.873243	valid_1's binary_logloss: 0.139828	valid_1's auc: 0.837467
[29]	valid_0's binary_logloss: 0.124164	valid_0's auc: 0.873959	valid_1's binary_logloss: 0.139781	valid_1's auc: 0.83751
[30]	valid_0's binary_logloss: 0.123934	valid_0's auc: 0.874666	valid_1's binary_logloss: 0.139667	valid_1's auc: 0.837891
[31]	valid_0's binary_logloss: 0.123703	valid_0's auc: 0.875615	valid_1's binary_logloss: 0.139545	valid_1's auc: 0.83861
[32]	valid_0's binary_logloss: 0.123475	valid_0's auc: 0.876151	valid_1's binary_logloss: 0.13945	valid_1's auc: 0.838762
[33]	valid_0's binary_logloss: 0.123248	valid_0's auc: 0.877026	valid_1's binary_logloss: 0.139439	valid_1's auc: 0.838799
[34]	valid_0's binary_logloss: 0.123057	valid_0's auc: 0.877606	valid_1's binary_logloss: 0.139447	valid_1's auc: 0.838511
[35]	valid_0's binary_logloss: 0.122861	valid_0's auc: 0.878266	valid_1's binary_logloss: 0.139413	valid_1's auc: 0.838604
[36]	valid_0's binary_logloss: 0.122635	valid_0's auc: 0.87885	valid_1's binary_logloss: 0.139347	valid_1's auc: 0.838919
[37]	valid_0's binary_logloss: 0.12236	valid_0's auc: 0.879609	valid_1's binary_logloss: 0.139342	valid_1's auc: 0.83891
[38]	valid_0's binary_logloss: 0.12211	valid_0's auc: 0.879941	valid_1's binary_logloss: 0.139438	valid_1's auc: 0.838586
[39]	valid_0's binary_logloss: 0.121864	valid_0's auc: 0.880723	valid_1's binary_logloss: 0.139421	valid_1's auc: 0.838655
[40]	valid_0's binary_logloss: 0.121708	valid_0's auc: 0.881052	valid_1's binary_logloss: 0.139358	valid_1's auc: 0.83903
[41]	valid_0's binary_logloss: 0.12146	valid_0's auc: 0.881719	valid_1's binary_logloss: 0.139353	valid_1's auc: 0.83903
[42]	valid_0's binary_logloss: 0.121168	valid_0's auc: 0.882841	valid_1's binary_logloss: 0.139266	valid_1's auc: 0.83955
[43]	valid_0's binary_logloss: 0.120936	valid_0's auc: 0.883416	valid_1's binary_logloss: 0.139368	valid_1's auc: 0.839046
[44]	valid_0's binary_logloss: 0.120707	valid_0's auc: 0.883946	valid_1's binary_logloss: 0.139372	valid_1's auc: 0.839079
[45]	valid_0's binary_logloss: 0.120517	valid_0's auc: 0.884413	valid_1's binary_logloss: 0.139355	valid_1's auc: 0.839058
[46]	valid_0's binary_logloss: 0.120366	valid_0's auc: 0.884779	valid_1's binary_logloss: 0.139393	valid_1's auc: 0.839074
[47]	valid_0's binary_logloss: 0.120167	valid_0's auc: 0.885151	valid_1's binary_logloss: 0.139448	valid_1's auc: 0.838763
[48]	valid_0's binary_logloss: 0.120017	valid_0's auc: 0.885423	valid_1's binary_logloss: 0.13953	valid_1's auc: 0.838439
[49]	valid_0's binary_logloss: 0.119829	valid_0's auc: 0.885803	valid_1's binary_logloss: 0.139561	valid_1's auc: 0.83829
[50]	valid_0's binary_logloss: 0.119647	valid_0's auc: 0.886174	valid_1's binary_logloss: 0.139549	valid_1's auc: 0.838535
[51]	valid_0's binary_logloss: 0.119508	valid_0's auc: 0.886427	valid_1's binary_logloss: 0.139591	valid_1's auc: 0.838257
[52]	valid_0's binary_logloss: 0.119359	valid_0's auc: 0.886951	valid_1's binary_logloss: 0.139563	valid_1's auc: 0.838568
[53]	valid_0's binary_logloss: 0.119176	valid_0's auc: 0.887355	valid_1's binary_logloss: 0.139628	valid_1's auc: 0.838543
[54]	valid_0's binary_logloss: 0.118981	valid_0's auc: 0.887921	valid_1's binary_logloss: 0.139624	valid_1's auc: 0.838756
[55]	valid_0's binary_logloss: 0.118841	valid_0's auc: 0.888212	valid_1's binary_logloss: 0.139629	valid_1's auc: 0.838784
[56]	valid_0's binary_logloss: 0.118658	valid_0's auc: 0.888594	valid_1's binary_logloss: 0.139663	valid_1's auc: 0.838629
[57]	valid_0's binary_logloss: 0.118515	valid_0's auc: 0.888819	valid_1's binary_logloss: 0.139621	valid_1's auc: 0.838717
[58]	valid_0's binary_logloss: 0.118357	valid_0's auc: 0.889162	valid_1's binary_logloss: 0.139688	valid_1's auc: 0.838462
[59]	valid_0's binary_logloss: 0.118197	valid_0's auc: 0.889806	valid_1's binary_logloss: 0.139725	valid_1's auc: 0.838289
[60]	valid_0's binary_logloss: 0.118088	valid_0's auc: 0.889976	valid_1's binary_logloss: 0.139761	valid_1's auc: 0.83829
[61]	valid_0's binary_logloss: 0.117943	valid_0's auc: 0.890299	valid_1's binary_logloss: 0.139821	valid_1's auc: 0.838077
[62]	valid_0's binary_logloss: 0.117814	valid_0's auc: 0.890524	valid_1's binary_logloss: 0.139809	valid_1's auc: 0.838161
[63]	valid_0's binary_logloss: 0.117695	valid_0's auc: 0.890741	valid_1's binary_logloss: 0.139891	valid_1's auc: 0.837883
[64]	valid_0's binary_logloss: 0.117563	valid_0's auc: 0.891078	valid_1's binary_logloss: 0.139952	valid_1's auc: 0.837654
[65]	valid_0's binary_logloss: 0.117396	valid_0's auc: 0.891298	valid_1's binary_logloss: 0.139936	valid_1's auc: 0.837908
[66]	valid_0's binary_logloss: 0.117294	valid_0's auc: 0.891444	valid_1's binary_logloss: 0.139968	valid_1's auc: 0.837798
[67]	valid_0's binary_logloss: 0.117199	valid_0's auc: 0.891558	valid_1's binary_logloss: 0.139951	valid_1's auc: 0.837884
[68]	valid_0's binary_logloss: 0.117047	valid_0's auc: 0.891842	valid_1's binary_logloss: 0.139964	valid_1's auc: 0.837726
[69]	valid_0's binary_logloss: 0.116905	valid_0's auc: 0.892333	valid_1's binary_logloss: 0.140006	valid_1's auc: 0.837619
[70]	valid_0's binary_logloss: 0.116695	valid_0's auc: 0.892833	valid_1's binary_logloss: 0.139965	valid_1's auc: 0.837858
[71]	valid_0's binary_logloss: 0.116607	valid_0's auc: 0.892846	valid_1's binary_logloss: 0.140063	valid_1's auc: 0.837642
[72]	valid_0's binary_logloss: 0.116525	valid_0's auc: 0.892948	valid_1's binary_logloss: 0.140129	valid_1's auc: 0.837423
Early stopping, best iteration is:
[42]	valid_0's binary_logloss: 0.121168	valid_0's auc: 0.882841	valid_1's binary_logloss: 0.139266	valid_1's auc: 0.83955
[1]	valid_0's binary_logloss: 0.156528	valid_0's auc: 0.821645	valid_1's binary_logloss: 0.165101	valid_1's auc: 0.81857
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151187	valid_0's auc: 0.827652	valid_1's binary_logloss: 0.160088	valid_1's auc: 0.82254
[3]	valid_0's binary_logloss: 0.147263	valid_0's auc: 0.836059	valid_1's binary_logloss: 0.156608	valid_1's auc: 0.828121
[4]	valid_0's binary_logloss: 0.144258	valid_0's auc: 0.840507	valid_1's binary_logloss: 0.153573	valid_1's auc: 0.831883
[5]	valid_0's binary_logloss: 0.141763	valid_0's auc: 0.841889	valid_1's binary_logloss: 0.151258	valid_1's auc: 0.834129
[6]	valid_0's binary_logloss: 0.139749	valid_0's auc: 0.84495	valid_1's binary_logloss: 0.149359	valid_1's auc: 0.835139
[7]	valid_0's binary_logloss: 0.138082	valid_0's auc: 0.845803	valid_1's binary_logloss: 0.147853	valid_1's auc: 0.834809
[8]	valid_0's binary_logloss: 0.136693	valid_0's auc: 0.847136	valid_1's binary_logloss: 0.146585	valid_1's auc: 0.836717
[9]	valid_0's binary_logloss: 0.135437	valid_0's auc: 0.849549	valid_1's binary_logloss: 0.145575	valid_1's auc: 0.837358
[10]	valid_0's binary_logloss: 0.134374	valid_0's auc: 0.850797	valid_1's binary_logloss: 0.144671	valid_1's auc: 0.83794
[11]	valid_0's binary_logloss: 0.133441	valid_0's auc: 0.85216	valid_1's binary_logloss: 0.143939	valid_1's auc: 0.83805
[12]	valid_0's binary_logloss: 0.132621	valid_0's auc: 0.854509	valid_1's binary_logloss: 0.143406	valid_1's auc: 0.838172
[13]	valid_0's binary_logloss: 0.131801	valid_0's auc: 0.856837	valid_1's binary_logloss: 0.142845	valid_1's auc: 0.838172
[14]	valid_0's binary_logloss: 0.131085	valid_0's auc: 0.858379	valid_1's binary_logloss: 0.142438	valid_1's auc: 0.838161
[15]	valid_0's binary_logloss: 0.130403	valid_0's auc: 0.859828	valid_1's binary_logloss: 0.142128	valid_1's auc: 0.837333
[16]	valid_0's binary_logloss: 0.129848	valid_0's auc: 0.861034	valid_1's binary_logloss: 0.141806	valid_1's auc: 0.836715
[17]	valid_0's binary_logloss: 0.129299	valid_0's auc: 0.861775	valid_1's binary_logloss: 0.141398	valid_1's auc: 0.837193
[18]	valid_0's binary_logloss: 0.128797	valid_0's auc: 0.862844	valid_1's binary_logloss: 0.141105	valid_1's auc: 0.837688
[19]	valid_0's binary_logloss: 0.128254	valid_0's auc: 0.864183	valid_1's binary_logloss: 0.1408	valid_1's auc: 0.838493
[20]	valid_0's binary_logloss: 0.127764	valid_0's auc: 0.865434	valid_1's binary_logloss: 0.140629	valid_1's auc: 0.83826
[21]	valid_0's binary_logloss: 0.127313	valid_0's auc: 0.866549	valid_1's binary_logloss: 0.140491	valid_1's auc: 0.83802
[22]	valid_0's binary_logloss: 0.126892	valid_0's auc: 0.867557	valid_1's binary_logloss: 0.140253	valid_1's auc: 0.838476
[23]	valid_0's binary_logloss: 0.126489	valid_0's auc: 0.868549	valid_1's binary_logloss: 0.14015	valid_1's auc: 0.838499
[24]	valid_0's binary_logloss: 0.126193	valid_0's auc: 0.869053	valid_1's binary_logloss: 0.139968	valid_1's auc: 0.83904
[25]	valid_0's binary_logloss: 0.12589	valid_0's auc: 0.869728	valid_1's binary_logloss: 0.139803	valid_1's auc: 0.839059
[26]	valid_0's binary_logloss: 0.125571	valid_0's auc: 0.870373	valid_1's binary_logloss: 0.139698	valid_1's auc: 0.839138
[27]	valid_0's binary_logloss: 0.125257	valid_0's auc: 0.871341	valid_1's binary_logloss: 0.139664	valid_1's auc: 0.838837
[28]	valid_0's binary_logloss: 0.124955	valid_0's auc: 0.872255	valid_1's binary_logloss: 0.139614	valid_1's auc: 0.838733
[29]	valid_0's binary_logloss: 0.124683	valid_0's auc: 0.872979	valid_1's binary_logloss: 0.139634	valid_1's auc: 0.838445
[30]	valid_0's binary_logloss: 0.12443	valid_0's auc: 0.873557	valid_1's binary_logloss: 0.139581	valid_1's auc: 0.838392
[31]	valid_0's binary_logloss: 0.124188	valid_0's auc: 0.874202	valid_1's binary_logloss: 0.139633	valid_1's auc: 0.837993
[32]	valid_0's binary_logloss: 0.123929	valid_0's auc: 0.874831	valid_1's binary_logloss: 0.139651	valid_1's auc: 0.837759
[33]	valid_0's binary_logloss: 0.123718	valid_0's auc: 0.87536	valid_1's binary_logloss: 0.139601	valid_1's auc: 0.838121
[34]	valid_0's binary_logloss: 0.123446	valid_0's auc: 0.876098	valid_1's binary_logloss: 0.13959	valid_1's auc: 0.838127
[35]	valid_0's binary_logloss: 0.123227	valid_0's auc: 0.876685	valid_1's binary_logloss: 0.139632	valid_1's auc: 0.837767
[36]	valid_0's binary_logloss: 0.122984	valid_0's auc: 0.877273	valid_1's binary_logloss: 0.139635	valid_1's auc: 0.837941
[37]	valid_0's binary_logloss: 0.12276	valid_0's auc: 0.877868	valid_1's binary_logloss: 0.139578	valid_1's auc: 0.83805
[38]	valid_0's binary_logloss: 0.122494	valid_0's auc: 0.878325	valid_1's binary_logloss: 0.139527	valid_1's auc: 0.83832
[39]	valid_0's binary_logloss: 0.122248	valid_0's auc: 0.878917	valid_1's binary_logloss: 0.139516	valid_1's auc: 0.838503
[40]	valid_0's binary_logloss: 0.122038	valid_0's auc: 0.879406	valid_1's binary_logloss: 0.139475	valid_1's auc: 0.838825
[41]	valid_0's binary_logloss: 0.121865	valid_0's auc: 0.87982	valid_1's binary_logloss: 0.139525	valid_1's auc: 0.838607
[42]	valid_0's binary_logloss: 0.121697	valid_0's auc: 0.880217	valid_1's binary_logloss: 0.139582	valid_1's auc: 0.838459
[43]	valid_0's binary_logloss: 0.121448	valid_0's auc: 0.881131	valid_1's binary_logloss: 0.139571	valid_1's auc: 0.838519
[44]	valid_0's binary_logloss: 0.121268	valid_0's auc: 0.881502	valid_1's binary_logloss: 0.13955	valid_1's auc: 0.838652
[45]	valid_0's binary_logloss: 0.121081	valid_0's auc: 0.881982	valid_1's binary_logloss: 0.139559	valid_1's auc: 0.83858
[46]	valid_0's binary_logloss: 0.120906	valid_0's auc: 0.88233	valid_1's binary_logloss: 0.139657	valid_1's auc: 0.838247
[47]	valid_0's binary_logloss: 0.120707	valid_0's auc: 0.882781	valid_1's binary_logloss: 0.139655	valid_1's auc: 0.838252
[48]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.882987	valid_1's binary_logloss: 0.13965	valid_1's auc: 0.838213
[49]	valid_0's binary_logloss: 0.120348	valid_0's auc: 0.883422	valid_1's binary_logloss: 0.139707	valid_1's auc: 0.838107
[50]	valid_0's binary_logloss: 0.120181	valid_0's auc: 0.883798	valid_1's binary_logloss: 0.139747	valid_1's auc: 0.838134
[51]	valid_0's binary_logloss: 0.11997	valid_0's auc: 0.884299	valid_1's binary_logloss: 0.139789	valid_1's auc: 0.837738
[52]	valid_0's binary_logloss: 0.119771	valid_0's auc: 0.884801	valid_1's binary_logloss: 0.139841	valid_1's auc: 0.837647
[53]	valid_0's binary_logloss: 0.119577	valid_0's auc: 0.885413	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.837395
[54]	valid_0's binary_logloss: 0.119342	valid_0's auc: 0.885952	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.837545
[55]	valid_0's binary_logloss: 0.119167	valid_0's auc: 0.886405	valid_1's binary_logloss: 0.139935	valid_1's auc: 0.837432
[56]	valid_0's binary_logloss: 0.119038	valid_0's auc: 0.886617	valid_1's binary_logloss: 0.14002	valid_1's auc: 0.83708
Early stopping, best iteration is:
[26]	valid_0's binary_logloss: 0.125571	valid_0's auc: 0.870373	valid_1's binary_logloss: 0.139698	valid_1's auc: 0.839138
[1]	valid_0's binary_logloss: 0.155302	valid_0's auc: 0.832891	valid_1's binary_logloss: 0.164826	valid_1's auc: 0.818851
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.149839	valid_0's auc: 0.842061	valid_1's binary_logloss: 0.159948	valid_1's auc: 0.825811
[3]	valid_0's binary_logloss: 0.14568	valid_0's auc: 0.849289	valid_1's binary_logloss: 0.156323	valid_1's auc: 0.828876
[4]	valid_0's binary_logloss: 0.142471	valid_0's auc: 0.85217	valid_1's binary_logloss: 0.153508	valid_1's auc: 0.830597
[5]	valid_0's binary_logloss: 0.139777	valid_0's auc: 0.854239	valid_1's binary_logloss: 0.15132	valid_1's auc: 0.831714
[6]	valid_0's binary_logloss: 0.137571	valid_0's auc: 0.857317	valid_1's binary_logloss: 0.149408	valid_1's auc: 0.834748
[7]	valid_0's binary_logloss: 0.13571	valid_0's auc: 0.860006	valid_1's binary_logloss: 0.14797	valid_1's auc: 0.834676
[8]	valid_0's binary_logloss: 0.134125	valid_0's auc: 0.862097	valid_1's binary_logloss: 0.146851	valid_1's auc: 0.833523
[9]	valid_0's binary_logloss: 0.132674	valid_0's auc: 0.863502	valid_1's binary_logloss: 0.145855	valid_1's auc: 0.83389
[10]	valid_0's binary_logloss: 0.131436	valid_0's auc: 0.865388	valid_1's binary_logloss: 0.145006	valid_1's auc: 0.83527
[11]	valid_0's binary_logloss: 0.130246	valid_0's auc: 0.867991	valid_1's binary_logloss: 0.14443	valid_1's auc: 0.834165
[12]	valid_0's binary_logloss: 0.129245	valid_0's auc: 0.868905	valid_1's binary_logloss: 0.143794	valid_1's auc: 0.834913
[13]	valid_0's binary_logloss: 0.128279	valid_0's auc: 0.871383	valid_1's binary_logloss: 0.143188	valid_1's auc: 0.835098
[14]	valid_0's binary_logloss: 0.127403	valid_0's auc: 0.872929	valid_1's binary_logloss: 0.142967	valid_1's auc: 0.833943
[15]	valid_0's binary_logloss: 0.126607	valid_0's auc: 0.87404	valid_1's binary_logloss: 0.142812	valid_1's auc: 0.833167
[16]	valid_0's binary_logloss: 0.12587	valid_0's auc: 0.875242	valid_1's binary_logloss: 0.142587	valid_1's auc: 0.832607
[17]	valid_0's binary_logloss: 0.125177	valid_0's auc: 0.876378	valid_1's binary_logloss: 0.142458	valid_1's auc: 0.83187
[18]	valid_0's binary_logloss: 0.124483	valid_0's auc: 0.877407	valid_1's binary_logloss: 0.142321	valid_1's auc: 0.83163
[19]	valid_0's binary_logloss: 0.123852	valid_0's auc: 0.878701	valid_1's binary_logloss: 0.142189	valid_1's auc: 0.831198
[20]	valid_0's binary_logloss: 0.123249	valid_0's auc: 0.880271	valid_1's binary_logloss: 0.142161	valid_1's auc: 0.830575
[21]	valid_0's binary_logloss: 0.122681	valid_0's auc: 0.881003	valid_1's binary_logloss: 0.142018	valid_1's auc: 0.830093
[22]	valid_0's binary_logloss: 0.122144	valid_0's auc: 0.882219	valid_1's binary_logloss: 0.141898	valid_1's auc: 0.829706
[23]	valid_0's binary_logloss: 0.121633	valid_0's auc: 0.883017	valid_1's binary_logloss: 0.14183	valid_1's auc: 0.829552
[24]	valid_0's binary_logloss: 0.121216	valid_0's auc: 0.883934	valid_1's binary_logloss: 0.14176	valid_1's auc: 0.829498
[25]	valid_0's binary_logloss: 0.120698	valid_0's auc: 0.885463	valid_1's binary_logloss: 0.141833	valid_1's auc: 0.828588
[26]	valid_0's binary_logloss: 0.120291	valid_0's auc: 0.886554	valid_1's binary_logloss: 0.141817	valid_1's auc: 0.8285
[27]	valid_0's binary_logloss: 0.119825	valid_0's auc: 0.887374	valid_1's binary_logloss: 0.141826	valid_1's auc: 0.828014
[28]	valid_0's binary_logloss: 0.11942	valid_0's auc: 0.888077	valid_1's binary_logloss: 0.14177	valid_1's auc: 0.827886
[29]	valid_0's binary_logloss: 0.119041	valid_0's auc: 0.888773	valid_1's binary_logloss: 0.141763	valid_1's auc: 0.827921
[30]	valid_0's binary_logloss: 0.118672	valid_0's auc: 0.889591	valid_1's binary_logloss: 0.141616	valid_1's auc: 0.828616
[31]	valid_0's binary_logloss: 0.118339	valid_0's auc: 0.889981	valid_1's binary_logloss: 0.141555	valid_1's auc: 0.828525
[32]	valid_0's binary_logloss: 0.117949	valid_0's auc: 0.891237	valid_1's binary_logloss: 0.141603	valid_1's auc: 0.828309
[33]	valid_0's binary_logloss: 0.117655	valid_0's auc: 0.891831	valid_1's binary_logloss: 0.141685	valid_1's auc: 0.827914
[34]	valid_0's binary_logloss: 0.117339	valid_0's auc: 0.892391	valid_1's binary_logloss: 0.141814	valid_1's auc: 0.827348
[35]	valid_0's binary_logloss: 0.116984	valid_0's auc: 0.893036	valid_1's binary_logloss: 0.141867	valid_1's auc: 0.827162
[36]	valid_0's binary_logloss: 0.116643	valid_0's auc: 0.893952	valid_1's binary_logloss: 0.141919	valid_1's auc: 0.82722
[37]	valid_0's binary_logloss: 0.116343	valid_0's auc: 0.894628	valid_1's binary_logloss: 0.141964	valid_1's auc: 0.827088
[38]	valid_0's binary_logloss: 0.11609	valid_0's auc: 0.895063	valid_1's binary_logloss: 0.141947	valid_1's auc: 0.827376
[39]	valid_0's binary_logloss: 0.115776	valid_0's auc: 0.895511	valid_1's binary_logloss: 0.142035	valid_1's auc: 0.826977
[40]	valid_0's binary_logloss: 0.115526	valid_0's auc: 0.895873	valid_1's binary_logloss: 0.142022	valid_1's auc: 0.827266
Early stopping, best iteration is:
[10]	valid_0's binary_logloss: 0.131436	valid_0's auc: 0.865388	valid_1's binary_logloss: 0.145006	valid_1's auc: 0.83527
[1]	valid_0's binary_logloss: 0.15572	valid_0's auc: 0.833054	valid_1's binary_logloss: 0.165036	valid_1's auc: 0.817048
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.14989	valid_0's auc: 0.841411	valid_1's binary_logloss: 0.159541	valid_1's auc: 0.821568
[3]	valid_0's binary_logloss: 0.14572	valid_0's auc: 0.849517	valid_1's binary_logloss: 0.155987	valid_1's auc: 0.82788
[4]	valid_0's binary_logloss: 0.142455	valid_0's auc: 0.853918	valid_1's binary_logloss: 0.153089	valid_1's auc: 0.830738
[5]	valid_0's binary_logloss: 0.139735	valid_0's auc: 0.857301	valid_1's binary_logloss: 0.150632	valid_1's auc: 0.834385
[6]	valid_0's binary_logloss: 0.137505	valid_0's auc: 0.860317	valid_1's binary_logloss: 0.148792	valid_1's auc: 0.834978
[7]	valid_0's binary_logloss: 0.135605	valid_0's auc: 0.862342	valid_1's binary_logloss: 0.147286	valid_1's auc: 0.836808
[8]	valid_0's binary_logloss: 0.133938	valid_0's auc: 0.863801	valid_1's binary_logloss: 0.146148	valid_1's auc: 0.836233
[9]	valid_0's binary_logloss: 0.132456	valid_0's auc: 0.865686	valid_1's binary_logloss: 0.145138	valid_1's auc: 0.836224
[10]	valid_0's binary_logloss: 0.131167	valid_0's auc: 0.867095	valid_1's binary_logloss: 0.144312	valid_1's auc: 0.83568
[11]	valid_0's binary_logloss: 0.130032	valid_0's auc: 0.868321	valid_1's binary_logloss: 0.143512	valid_1's auc: 0.836598
[12]	valid_0's binary_logloss: 0.128915	valid_0's auc: 0.870342	valid_1's binary_logloss: 0.142896	valid_1's auc: 0.836786
[13]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.871602	valid_1's binary_logloss: 0.142313	valid_1's auc: 0.837475
[14]	valid_0's binary_logloss: 0.127074	valid_0's auc: 0.873492	valid_1's binary_logloss: 0.141918	valid_1's auc: 0.837308
[15]	valid_0's binary_logloss: 0.126249	valid_0's auc: 0.874714	valid_1's binary_logloss: 0.141545	valid_1's auc: 0.837265
[16]	valid_0's binary_logloss: 0.125412	valid_0's auc: 0.876498	valid_1's binary_logloss: 0.141306	valid_1's auc: 0.837064
[17]	valid_0's binary_logloss: 0.124674	valid_0's auc: 0.877697	valid_1's binary_logloss: 0.141243	valid_1's auc: 0.835667
[18]	valid_0's binary_logloss: 0.124004	valid_0's auc: 0.878754	valid_1's binary_logloss: 0.141001	valid_1's auc: 0.836266
[19]	valid_0's binary_logloss: 0.123324	valid_0's auc: 0.880151	valid_1's binary_logloss: 0.14069	valid_1's auc: 0.836858
[20]	valid_0's binary_logloss: 0.122647	valid_0's auc: 0.88214	valid_1's binary_logloss: 0.140681	valid_1's auc: 0.83574
[21]	valid_0's binary_logloss: 0.12205	valid_0's auc: 0.883119	valid_1's binary_logloss: 0.140627	valid_1's auc: 0.83555
[22]	valid_0's binary_logloss: 0.121526	valid_0's auc: 0.884243	valid_1's binary_logloss: 0.140488	valid_1's auc: 0.83609
[23]	valid_0's binary_logloss: 0.120992	valid_0's auc: 0.885369	valid_1's binary_logloss: 0.140443	valid_1's auc: 0.835781
[24]	valid_0's binary_logloss: 0.120502	valid_0's auc: 0.886215	valid_1's binary_logloss: 0.140363	valid_1's auc: 0.835501
[25]	valid_0's binary_logloss: 0.119975	valid_0's auc: 0.887513	valid_1's binary_logloss: 0.140274	valid_1's auc: 0.835926
[26]	valid_0's binary_logloss: 0.119497	valid_0's auc: 0.888713	valid_1's binary_logloss: 0.140329	valid_1's auc: 0.835254
[27]	valid_0's binary_logloss: 0.11904	valid_0's auc: 0.889795	valid_1's binary_logloss: 0.140341	valid_1's auc: 0.835371
[28]	valid_0's binary_logloss: 0.118653	valid_0's auc: 0.8904	valid_1's binary_logloss: 0.140409	valid_1's auc: 0.834904
[29]	valid_0's binary_logloss: 0.118177	valid_0's auc: 0.891515	valid_1's binary_logloss: 0.14043	valid_1's auc: 0.834421
[30]	valid_0's binary_logloss: 0.117737	valid_0's auc: 0.892538	valid_1's binary_logloss: 0.14048	valid_1's auc: 0.834461
[31]	valid_0's binary_logloss: 0.11742	valid_0's auc: 0.893059	valid_1's binary_logloss: 0.140513	valid_1's auc: 0.834053
[32]	valid_0's binary_logloss: 0.117057	valid_0's auc: 0.893934	valid_1's binary_logloss: 0.140434	valid_1's auc: 0.83418
[33]	valid_0's binary_logloss: 0.116716	valid_0's auc: 0.894932	valid_1's binary_logloss: 0.140491	valid_1's auc: 0.833793
[34]	valid_0's binary_logloss: 0.116371	valid_0's auc: 0.895434	valid_1's binary_logloss: 0.140476	valid_1's auc: 0.834146
[35]	valid_0's binary_logloss: 0.11604	valid_0's auc: 0.896238	valid_1's binary_logloss: 0.140613	valid_1's auc: 0.833608
[36]	valid_0's binary_logloss: 0.115738	valid_0's auc: 0.896761	valid_1's binary_logloss: 0.140566	valid_1's auc: 0.833866
[37]	valid_0's binary_logloss: 0.115445	valid_0's auc: 0.897255	valid_1's binary_logloss: 0.140618	valid_1's auc: 0.833835
[38]	valid_0's binary_logloss: 0.115107	valid_0's auc: 0.897979	valid_1's binary_logloss: 0.14069	valid_1's auc: 0.833409
[39]	valid_0's binary_logloss: 0.114705	valid_0's auc: 0.898947	valid_1's binary_logloss: 0.140754	valid_1's auc: 0.833262
[40]	valid_0's binary_logloss: 0.114409	valid_0's auc: 0.899579	valid_1's binary_logloss: 0.140759	valid_1's auc: 0.833304
[41]	valid_0's binary_logloss: 0.114104	valid_0's auc: 0.900418	valid_1's binary_logloss: 0.140854	valid_1's auc: 0.833244
[42]	valid_0's binary_logloss: 0.113727	valid_0's auc: 0.901143	valid_1's binary_logloss: 0.14096	valid_1's auc: 0.83271
[43]	valid_0's binary_logloss: 0.113493	valid_0's auc: 0.901603	valid_1's binary_logloss: 0.141012	valid_1's auc: 0.832882
Early stopping, best iteration is:
[13]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.871602	valid_1's binary_logloss: 0.142313	valid_1's auc: 0.837475
[1]	valid_0's binary_logloss: 0.155759	valid_0's auc: 0.830643	valid_1's binary_logloss: 0.164985	valid_1's auc: 0.816734
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.149985	valid_0's auc: 0.839231	valid_1's binary_logloss: 0.159847	valid_1's auc: 0.822161
[3]	valid_0's binary_logloss: 0.14584	valid_0's auc: 0.847482	valid_1's binary_logloss: 0.156209	valid_1's auc: 0.828931
[4]	valid_0's binary_logloss: 0.142477	valid_0's auc: 0.85096	valid_1's binary_logloss: 0.153261	valid_1's auc: 0.83076
[5]	valid_0's binary_logloss: 0.139743	valid_0's auc: 0.854424	valid_1's binary_logloss: 0.150964	valid_1's auc: 0.832373
[6]	valid_0's binary_logloss: 0.137578	valid_0's auc: 0.856208	valid_1's binary_logloss: 0.149014	valid_1's auc: 0.835151
[7]	valid_0's binary_logloss: 0.135714	valid_0's auc: 0.857684	valid_1's binary_logloss: 0.147459	valid_1's auc: 0.836459
[8]	valid_0's binary_logloss: 0.134043	valid_0's auc: 0.859848	valid_1's binary_logloss: 0.146266	valid_1's auc: 0.835502
[9]	valid_0's binary_logloss: 0.132596	valid_0's auc: 0.862422	valid_1's binary_logloss: 0.145301	valid_1's auc: 0.835298
[10]	valid_0's binary_logloss: 0.131312	valid_0's auc: 0.86448	valid_1's binary_logloss: 0.144368	valid_1's auc: 0.836102
[11]	valid_0's binary_logloss: 0.130164	valid_0's auc: 0.86587	valid_1's binary_logloss: 0.14376	valid_1's auc: 0.836347
[12]	valid_0's binary_logloss: 0.129168	valid_0's auc: 0.867975	valid_1's binary_logloss: 0.143155	valid_1's auc: 0.836728
[13]	valid_0's binary_logloss: 0.128157	valid_0's auc: 0.870558	valid_1's binary_logloss: 0.142684	valid_1's auc: 0.836515
[14]	valid_0's binary_logloss: 0.127255	valid_0's auc: 0.872242	valid_1's binary_logloss: 0.142312	valid_1's auc: 0.836322
[15]	valid_0's binary_logloss: 0.126426	valid_0's auc: 0.873758	valid_1's binary_logloss: 0.14194	valid_1's auc: 0.836377
[16]	valid_0's binary_logloss: 0.125659	valid_0's auc: 0.875262	valid_1's binary_logloss: 0.141765	valid_1's auc: 0.835719
[17]	valid_0's binary_logloss: 0.124929	valid_0's auc: 0.876886	valid_1's binary_logloss: 0.141548	valid_1's auc: 0.835566
[18]	valid_0's binary_logloss: 0.124244	valid_0's auc: 0.878549	valid_1's binary_logloss: 0.141281	valid_1's auc: 0.835682
[19]	valid_0's binary_logloss: 0.12357	valid_0's auc: 0.880422	valid_1's binary_logloss: 0.141181	valid_1's auc: 0.835543
[20]	valid_0's binary_logloss: 0.123016	valid_0's auc: 0.881339	valid_1's binary_logloss: 0.140981	valid_1's auc: 0.835789
[21]	valid_0's binary_logloss: 0.12242	valid_0's auc: 0.882595	valid_1's binary_logloss: 0.140807	valid_1's auc: 0.83617
[22]	valid_0's binary_logloss: 0.121854	valid_0's auc: 0.883944	valid_1's binary_logloss: 0.140685	valid_1's auc: 0.835977
[23]	valid_0's binary_logloss: 0.121312	valid_0's auc: 0.884786	valid_1's binary_logloss: 0.140658	valid_1's auc: 0.835988
[24]	valid_0's binary_logloss: 0.120748	valid_0's auc: 0.88598	valid_1's binary_logloss: 0.140629	valid_1's auc: 0.83552
[25]	valid_0's binary_logloss: 0.120274	valid_0's auc: 0.887201	valid_1's binary_logloss: 0.14052	valid_1's auc: 0.835925
[26]	valid_0's binary_logloss: 0.119775	valid_0's auc: 0.888423	valid_1's binary_logloss: 0.140493	valid_1's auc: 0.835694
[27]	valid_0's binary_logloss: 0.119337	valid_0's auc: 0.889313	valid_1's binary_logloss: 0.140489	valid_1's auc: 0.835559
[28]	valid_0's binary_logloss: 0.118884	valid_0's auc: 0.890034	valid_1's binary_logloss: 0.14046	valid_1's auc: 0.835284
[29]	valid_0's binary_logloss: 0.11848	valid_0's auc: 0.890803	valid_1's binary_logloss: 0.14033	valid_1's auc: 0.835875
[30]	valid_0's binary_logloss: 0.118067	valid_0's auc: 0.891689	valid_1's binary_logloss: 0.140375	valid_1's auc: 0.835628
[31]	valid_0's binary_logloss: 0.117678	valid_0's auc: 0.892688	valid_1's binary_logloss: 0.140399	valid_1's auc: 0.835223
[32]	valid_0's binary_logloss: 0.117315	valid_0's auc: 0.893404	valid_1's binary_logloss: 0.140444	valid_1's auc: 0.834945
[33]	valid_0's binary_logloss: 0.116905	valid_0's auc: 0.894165	valid_1's binary_logloss: 0.140407	valid_1's auc: 0.834973
[34]	valid_0's binary_logloss: 0.116504	valid_0's auc: 0.895202	valid_1's binary_logloss: 0.140299	valid_1's auc: 0.835507
[35]	valid_0's binary_logloss: 0.116137	valid_0's auc: 0.896193	valid_1's binary_logloss: 0.140215	valid_1's auc: 0.835906
[36]	valid_0's binary_logloss: 0.115852	valid_0's auc: 0.896674	valid_1's binary_logloss: 0.140177	valid_1's auc: 0.836061
[37]	valid_0's binary_logloss: 0.115534	valid_0's auc: 0.897433	valid_1's binary_logloss: 0.140099	valid_1's auc: 0.836293
[38]	valid_0's binary_logloss: 0.115209	valid_0's auc: 0.897849	valid_1's binary_logloss: 0.140252	valid_1's auc: 0.835887
[39]	valid_0's binary_logloss: 0.114876	valid_0's auc: 0.898318	valid_1's binary_logloss: 0.140398	valid_1's auc: 0.835559
[40]	valid_0's binary_logloss: 0.114599	valid_0's auc: 0.898626	valid_1's binary_logloss: 0.140471	valid_1's auc: 0.835318
[41]	valid_0's binary_logloss: 0.114312	valid_0's auc: 0.899041	valid_1's binary_logloss: 0.140386	valid_1's auc: 0.835822
[42]	valid_0's binary_logloss: 0.114071	valid_0's auc: 0.899694	valid_1's binary_logloss: 0.140332	valid_1's auc: 0.836277
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.129168	valid_0's auc: 0.867975	valid_1's binary_logloss: 0.143155	valid_1's auc: 0.836728
[1]	valid_0's binary_logloss: 0.155302	valid_0's auc: 0.832891	valid_1's binary_logloss: 0.164826	valid_1's auc: 0.818851
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.149839	valid_0's auc: 0.842061	valid_1's binary_logloss: 0.159948	valid_1's auc: 0.825811
[3]	valid_0's binary_logloss: 0.14568	valid_0's auc: 0.849289	valid_1's binary_logloss: 0.156323	valid_1's auc: 0.828876
[4]	valid_0's binary_logloss: 0.142471	valid_0's auc: 0.85217	valid_1's binary_logloss: 0.153508	valid_1's auc: 0.830597
[5]	valid_0's binary_logloss: 0.139777	valid_0's auc: 0.854239	valid_1's binary_logloss: 0.15132	valid_1's auc: 0.831714
[6]	valid_0's binary_logloss: 0.137571	valid_0's auc: 0.857317	valid_1's binary_logloss: 0.149408	valid_1's auc: 0.834748
[7]	valid_0's binary_logloss: 0.13571	valid_0's auc: 0.860006	valid_1's binary_logloss: 0.14797	valid_1's auc: 0.834676
[8]	valid_0's binary_logloss: 0.134125	valid_0's auc: 0.862097	valid_1's binary_logloss: 0.146851	valid_1's auc: 0.833523
[9]	valid_0's binary_logloss: 0.132674	valid_0's auc: 0.863502	valid_1's binary_logloss: 0.145855	valid_1's auc: 0.83389
[10]	valid_0's binary_logloss: 0.131436	valid_0's auc: 0.865388	valid_1's binary_logloss: 0.145006	valid_1's auc: 0.83527
[11]	valid_0's binary_logloss: 0.130246	valid_0's auc: 0.867991	valid_1's binary_logloss: 0.14443	valid_1's auc: 0.834165
[12]	valid_0's binary_logloss: 0.129245	valid_0's auc: 0.868905	valid_1's binary_logloss: 0.143794	valid_1's auc: 0.834913
[13]	valid_0's binary_logloss: 0.128279	valid_0's auc: 0.871383	valid_1's binary_logloss: 0.143188	valid_1's auc: 0.835098
[14]	valid_0's binary_logloss: 0.127403	valid_0's auc: 0.872929	valid_1's binary_logloss: 0.142967	valid_1's auc: 0.833943
[15]	valid_0's binary_logloss: 0.126607	valid_0's auc: 0.87404	valid_1's binary_logloss: 0.142812	valid_1's auc: 0.833167
[16]	valid_0's binary_logloss: 0.12587	valid_0's auc: 0.875242	valid_1's binary_logloss: 0.142587	valid_1's auc: 0.832607
[17]	valid_0's binary_logloss: 0.125177	valid_0's auc: 0.876378	valid_1's binary_logloss: 0.142458	valid_1's auc: 0.83187
[18]	valid_0's binary_logloss: 0.124483	valid_0's auc: 0.877407	valid_1's binary_logloss: 0.142321	valid_1's auc: 0.83163
[19]	valid_0's binary_logloss: 0.123852	valid_0's auc: 0.878701	valid_1's binary_logloss: 0.142189	valid_1's auc: 0.831198
[20]	valid_0's binary_logloss: 0.123249	valid_0's auc: 0.880271	valid_1's binary_logloss: 0.142161	valid_1's auc: 0.830575
[21]	valid_0's binary_logloss: 0.122681	valid_0's auc: 0.881003	valid_1's binary_logloss: 0.142018	valid_1's auc: 0.830093
[22]	valid_0's binary_logloss: 0.122144	valid_0's auc: 0.882219	valid_1's binary_logloss: 0.141898	valid_1's auc: 0.829706
[23]	valid_0's binary_logloss: 0.121633	valid_0's auc: 0.883017	valid_1's binary_logloss: 0.14183	valid_1's auc: 0.829552
[24]	valid_0's binary_logloss: 0.121216	valid_0's auc: 0.883934	valid_1's binary_logloss: 0.14176	valid_1's auc: 0.829498
[25]	valid_0's binary_logloss: 0.120698	valid_0's auc: 0.885463	valid_1's binary_logloss: 0.141833	valid_1's auc: 0.828588
[26]	valid_0's binary_logloss: 0.120291	valid_0's auc: 0.886554	valid_1's binary_logloss: 0.141817	valid_1's auc: 0.8285
[27]	valid_0's binary_logloss: 0.119825	valid_0's auc: 0.887374	valid_1's binary_logloss: 0.141826	valid_1's auc: 0.828014
[28]	valid_0's binary_logloss: 0.11942	valid_0's auc: 0.888077	valid_1's binary_logloss: 0.14177	valid_1's auc: 0.827886
[29]	valid_0's binary_logloss: 0.119041	valid_0's auc: 0.888773	valid_1's binary_logloss: 0.141763	valid_1's auc: 0.827921
[30]	valid_0's binary_logloss: 0.118672	valid_0's auc: 0.889591	valid_1's binary_logloss: 0.141616	valid_1's auc: 0.828616
[31]	valid_0's binary_logloss: 0.118339	valid_0's auc: 0.889981	valid_1's binary_logloss: 0.141555	valid_1's auc: 0.828525
[32]	valid_0's binary_logloss: 0.117949	valid_0's auc: 0.891237	valid_1's binary_logloss: 0.141603	valid_1's auc: 0.828309
[33]	valid_0's binary_logloss: 0.117655	valid_0's auc: 0.891831	valid_1's binary_logloss: 0.141685	valid_1's auc: 0.827914
[34]	valid_0's binary_logloss: 0.117339	valid_0's auc: 0.892391	valid_1's binary_logloss: 0.141814	valid_1's auc: 0.827348
[35]	valid_0's binary_logloss: 0.116984	valid_0's auc: 0.893036	valid_1's binary_logloss: 0.141867	valid_1's auc: 0.827162
[36]	valid_0's binary_logloss: 0.116643	valid_0's auc: 0.893952	valid_1's binary_logloss: 0.141919	valid_1's auc: 0.82722
[37]	valid_0's binary_logloss: 0.116343	valid_0's auc: 0.894628	valid_1's binary_logloss: 0.141964	valid_1's auc: 0.827088
[38]	valid_0's binary_logloss: 0.11609	valid_0's auc: 0.895063	valid_1's binary_logloss: 0.141947	valid_1's auc: 0.827376
[39]	valid_0's binary_logloss: 0.115776	valid_0's auc: 0.895511	valid_1's binary_logloss: 0.142035	valid_1's auc: 0.826977
[40]	valid_0's binary_logloss: 0.115526	valid_0's auc: 0.895873	valid_1's binary_logloss: 0.142022	valid_1's auc: 0.827266
Early stopping, best iteration is:
[10]	valid_0's binary_logloss: 0.131436	valid_0's auc: 0.865388	valid_1's binary_logloss: 0.145006	valid_1's auc: 0.83527
[1]	valid_0's binary_logloss: 0.15572	valid_0's auc: 0.833054	valid_1's binary_logloss: 0.165036	valid_1's auc: 0.817048
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.14989	valid_0's auc: 0.841411	valid_1's binary_logloss: 0.159541	valid_1's auc: 0.821568
[3]	valid_0's binary_logloss: 0.14572	valid_0's auc: 0.849517	valid_1's binary_logloss: 0.155987	valid_1's auc: 0.82788
[4]	valid_0's binary_logloss: 0.142455	valid_0's auc: 0.853918	valid_1's binary_logloss: 0.153089	valid_1's auc: 0.830738
[5]	valid_0's binary_logloss: 0.139735	valid_0's auc: 0.857301	valid_1's binary_logloss: 0.150632	valid_1's auc: 0.834385
[6]	valid_0's binary_logloss: 0.137505	valid_0's auc: 0.860317	valid_1's binary_logloss: 0.148792	valid_1's auc: 0.834978
[7]	valid_0's binary_logloss: 0.135605	valid_0's auc: 0.862342	valid_1's binary_logloss: 0.147286	valid_1's auc: 0.836808
[8]	valid_0's binary_logloss: 0.133938	valid_0's auc: 0.863801	valid_1's binary_logloss: 0.146148	valid_1's auc: 0.836233
[9]	valid_0's binary_logloss: 0.132456	valid_0's auc: 0.865686	valid_1's binary_logloss: 0.145138	valid_1's auc: 0.836224
[10]	valid_0's binary_logloss: 0.131167	valid_0's auc: 0.867095	valid_1's binary_logloss: 0.144312	valid_1's auc: 0.83568
[11]	valid_0's binary_logloss: 0.130032	valid_0's auc: 0.868321	valid_1's binary_logloss: 0.143512	valid_1's auc: 0.836598
[12]	valid_0's binary_logloss: 0.128915	valid_0's auc: 0.870342	valid_1's binary_logloss: 0.142896	valid_1's auc: 0.836786
[13]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.871602	valid_1's binary_logloss: 0.142313	valid_1's auc: 0.837475
[14]	valid_0's binary_logloss: 0.127074	valid_0's auc: 0.873492	valid_1's binary_logloss: 0.141918	valid_1's auc: 0.837308
[15]	valid_0's binary_logloss: 0.126249	valid_0's auc: 0.874714	valid_1's binary_logloss: 0.141545	valid_1's auc: 0.837265
[16]	valid_0's binary_logloss: 0.125412	valid_0's auc: 0.876498	valid_1's binary_logloss: 0.141306	valid_1's auc: 0.837064
[17]	valid_0's binary_logloss: 0.124674	valid_0's auc: 0.877697	valid_1's binary_logloss: 0.141243	valid_1's auc: 0.835667
[18]	valid_0's binary_logloss: 0.124004	valid_0's auc: 0.878754	valid_1's binary_logloss: 0.141001	valid_1's auc: 0.836266
[19]	valid_0's binary_logloss: 0.123324	valid_0's auc: 0.880151	valid_1's binary_logloss: 0.14069	valid_1's auc: 0.836858
[20]	valid_0's binary_logloss: 0.122647	valid_0's auc: 0.88214	valid_1's binary_logloss: 0.140681	valid_1's auc: 0.83574
[21]	valid_0's binary_logloss: 0.12205	valid_0's auc: 0.883119	valid_1's binary_logloss: 0.140627	valid_1's auc: 0.83555
[22]	valid_0's binary_logloss: 0.121526	valid_0's auc: 0.884243	valid_1's binary_logloss: 0.140488	valid_1's auc: 0.83609
[23]	valid_0's binary_logloss: 0.120992	valid_0's auc: 0.885369	valid_1's binary_logloss: 0.140443	valid_1's auc: 0.835781
[24]	valid_0's binary_logloss: 0.120502	valid_0's auc: 0.886215	valid_1's binary_logloss: 0.140363	valid_1's auc: 0.835501
[25]	valid_0's binary_logloss: 0.119975	valid_0's auc: 0.887513	valid_1's binary_logloss: 0.140274	valid_1's auc: 0.835926
[26]	valid_0's binary_logloss: 0.119497	valid_0's auc: 0.888713	valid_1's binary_logloss: 0.140329	valid_1's auc: 0.835254
[27]	valid_0's binary_logloss: 0.11904	valid_0's auc: 0.889795	valid_1's binary_logloss: 0.140341	valid_1's auc: 0.835371
[28]	valid_0's binary_logloss: 0.118653	valid_0's auc: 0.8904	valid_1's binary_logloss: 0.140409	valid_1's auc: 0.834904
[29]	valid_0's binary_logloss: 0.118177	valid_0's auc: 0.891515	valid_1's binary_logloss: 0.14043	valid_1's auc: 0.834421
[30]	valid_0's binary_logloss: 0.117737	valid_0's auc: 0.892538	valid_1's binary_logloss: 0.14048	valid_1's auc: 0.834461
[31]	valid_0's binary_logloss: 0.11742	valid_0's auc: 0.893059	valid_1's binary_logloss: 0.140513	valid_1's auc: 0.834053
[32]	valid_0's binary_logloss: 0.117057	valid_0's auc: 0.893934	valid_1's binary_logloss: 0.140434	valid_1's auc: 0.83418
[33]	valid_0's binary_logloss: 0.116716	valid_0's auc: 0.894932	valid_1's binary_logloss: 0.140491	valid_1's auc: 0.833793
[34]	valid_0's binary_logloss: 0.116371	valid_0's auc: 0.895434	valid_1's binary_logloss: 0.140476	valid_1's auc: 0.834146
[35]	valid_0's binary_logloss: 0.11604	valid_0's auc: 0.896238	valid_1's binary_logloss: 0.140613	valid_1's auc: 0.833608
[36]	valid_0's binary_logloss: 0.115738	valid_0's auc: 0.896761	valid_1's binary_logloss: 0.140566	valid_1's auc: 0.833866
[37]	valid_0's binary_logloss: 0.115445	valid_0's auc: 0.897255	valid_1's binary_logloss: 0.140618	valid_1's auc: 0.833835
[38]	valid_0's binary_logloss: 0.115107	valid_0's auc: 0.897979	valid_1's binary_logloss: 0.14069	valid_1's auc: 0.833409
[39]	valid_0's binary_logloss: 0.114705	valid_0's auc: 0.898947	valid_1's binary_logloss: 0.140754	valid_1's auc: 0.833262
[40]	valid_0's binary_logloss: 0.114409	valid_0's auc: 0.899579	valid_1's binary_logloss: 0.140759	valid_1's auc: 0.833304
[41]	valid_0's binary_logloss: 0.114104	valid_0's auc: 0.900418	valid_1's binary_logloss: 0.140854	valid_1's auc: 0.833244
[42]	valid_0's binary_logloss: 0.113727	valid_0's auc: 0.901143	valid_1's binary_logloss: 0.14096	valid_1's auc: 0.83271
[43]	valid_0's binary_logloss: 0.113493	valid_0's auc: 0.901603	valid_1's binary_logloss: 0.141012	valid_1's auc: 0.832882
Early stopping, best iteration is:
[13]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.871602	valid_1's binary_logloss: 0.142313	valid_1's auc: 0.837475
[1]	valid_0's binary_logloss: 0.155759	valid_0's auc: 0.830643	valid_1's binary_logloss: 0.164985	valid_1's auc: 0.816734
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.149985	valid_0's auc: 0.839231	valid_1's binary_logloss: 0.159847	valid_1's auc: 0.822161
[3]	valid_0's binary_logloss: 0.14584	valid_0's auc: 0.847482	valid_1's binary_logloss: 0.156209	valid_1's auc: 0.828931
[4]	valid_0's binary_logloss: 0.142477	valid_0's auc: 0.85096	valid_1's binary_logloss: 0.153261	valid_1's auc: 0.83076
[5]	valid_0's binary_logloss: 0.139743	valid_0's auc: 0.854424	valid_1's binary_logloss: 0.150964	valid_1's auc: 0.832373
[6]	valid_0's binary_logloss: 0.137578	valid_0's auc: 0.856208	valid_1's binary_logloss: 0.149014	valid_1's auc: 0.835151
[7]	valid_0's binary_logloss: 0.135714	valid_0's auc: 0.857684	valid_1's binary_logloss: 0.147459	valid_1's auc: 0.836459
[8]	valid_0's binary_logloss: 0.134043	valid_0's auc: 0.859848	valid_1's binary_logloss: 0.146266	valid_1's auc: 0.835502
[9]	valid_0's binary_logloss: 0.132596	valid_0's auc: 0.862422	valid_1's binary_logloss: 0.145301	valid_1's auc: 0.835298
[10]	valid_0's binary_logloss: 0.131312	valid_0's auc: 0.86448	valid_1's binary_logloss: 0.144368	valid_1's auc: 0.836102
[11]	valid_0's binary_logloss: 0.130164	valid_0's auc: 0.86587	valid_1's binary_logloss: 0.14376	valid_1's auc: 0.836347
[12]	valid_0's binary_logloss: 0.129168	valid_0's auc: 0.867975	valid_1's binary_logloss: 0.143155	valid_1's auc: 0.836728
[13]	valid_0's binary_logloss: 0.128157	valid_0's auc: 0.870558	valid_1's binary_logloss: 0.142684	valid_1's auc: 0.836515
[14]	valid_0's binary_logloss: 0.127255	valid_0's auc: 0.872242	valid_1's binary_logloss: 0.142312	valid_1's auc: 0.836322
[15]	valid_0's binary_logloss: 0.126426	valid_0's auc: 0.873758	valid_1's binary_logloss: 0.14194	valid_1's auc: 0.836377
[16]	valid_0's binary_logloss: 0.125659	valid_0's auc: 0.875262	valid_1's binary_logloss: 0.141765	valid_1's auc: 0.835719
[17]	valid_0's binary_logloss: 0.124929	valid_0's auc: 0.876886	valid_1's binary_logloss: 0.141548	valid_1's auc: 0.835566
[18]	valid_0's binary_logloss: 0.124244	valid_0's auc: 0.878549	valid_1's binary_logloss: 0.141281	valid_1's auc: 0.835682
[19]	valid_0's binary_logloss: 0.12357	valid_0's auc: 0.880422	valid_1's binary_logloss: 0.141181	valid_1's auc: 0.835543
[20]	valid_0's binary_logloss: 0.123016	valid_0's auc: 0.881339	valid_1's binary_logloss: 0.140981	valid_1's auc: 0.835789
[21]	valid_0's binary_logloss: 0.12242	valid_0's auc: 0.882595	valid_1's binary_logloss: 0.140807	valid_1's auc: 0.83617
[22]	valid_0's binary_logloss: 0.121854	valid_0's auc: 0.883944	valid_1's binary_logloss: 0.140685	valid_1's auc: 0.835977
[23]	valid_0's binary_logloss: 0.121312	valid_0's auc: 0.884786	valid_1's binary_logloss: 0.140658	valid_1's auc: 0.835988
[24]	valid_0's binary_logloss: 0.120748	valid_0's auc: 0.88598	valid_1's binary_logloss: 0.140629	valid_1's auc: 0.83552
[25]	valid_0's binary_logloss: 0.120274	valid_0's auc: 0.887201	valid_1's binary_logloss: 0.14052	valid_1's auc: 0.835925
[26]	valid_0's binary_logloss: 0.119775	valid_0's auc: 0.888423	valid_1's binary_logloss: 0.140493	valid_1's auc: 0.835694
[27]	valid_0's binary_logloss: 0.119337	valid_0's auc: 0.889313	valid_1's binary_logloss: 0.140489	valid_1's auc: 0.835559
[28]	valid_0's binary_logloss: 0.118884	valid_0's auc: 0.890034	valid_1's binary_logloss: 0.14046	valid_1's auc: 0.835284
[29]	valid_0's binary_logloss: 0.11848	valid_0's auc: 0.890803	valid_1's binary_logloss: 0.14033	valid_1's auc: 0.835875
[30]	valid_0's binary_logloss: 0.118067	valid_0's auc: 0.891689	valid_1's binary_logloss: 0.140375	valid_1's auc: 0.835628
[31]	valid_0's binary_logloss: 0.117678	valid_0's auc: 0.892688	valid_1's binary_logloss: 0.140399	valid_1's auc: 0.835223
[32]	valid_0's binary_logloss: 0.117315	valid_0's auc: 0.893404	valid_1's binary_logloss: 0.140444	valid_1's auc: 0.834945
[33]	valid_0's binary_logloss: 0.116905	valid_0's auc: 0.894165	valid_1's binary_logloss: 0.140407	valid_1's auc: 0.834973
[34]	valid_0's binary_logloss: 0.116504	valid_0's auc: 0.895202	valid_1's binary_logloss: 0.140299	valid_1's auc: 0.835507
[35]	valid_0's binary_logloss: 0.116137	valid_0's auc: 0.896193	valid_1's binary_logloss: 0.140215	valid_1's auc: 0.835906
[36]	valid_0's binary_logloss: 0.115852	valid_0's auc: 0.896674	valid_1's binary_logloss: 0.140177	valid_1's auc: 0.836061
[37]	valid_0's binary_logloss: 0.115534	valid_0's auc: 0.897433	valid_1's binary_logloss: 0.140099	valid_1's auc: 0.836293
[38]	valid_0's binary_logloss: 0.115209	valid_0's auc: 0.897849	valid_1's binary_logloss: 0.140252	valid_1's auc: 0.835887
[39]	valid_0's binary_logloss: 0.114876	valid_0's auc: 0.898318	valid_1's binary_logloss: 0.140398	valid_1's auc: 0.835559
[40]	valid_0's binary_logloss: 0.114599	valid_0's auc: 0.898626	valid_1's binary_logloss: 0.140471	valid_1's auc: 0.835318
[41]	valid_0's binary_logloss: 0.114312	valid_0's auc: 0.899041	valid_1's binary_logloss: 0.140386	valid_1's auc: 0.835822
[42]	valid_0's binary_logloss: 0.114071	valid_0's auc: 0.899694	valid_1's binary_logloss: 0.140332	valid_1's auc: 0.836277
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.129168	valid_0's auc: 0.867975	valid_1's binary_logloss: 0.143155	valid_1's auc: 0.836728
[1]	valid_0's binary_logloss: 0.156222	valid_0's auc: 0.824873	valid_1's binary_logloss: 0.165072	valid_1's auc: 0.817791
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151167	valid_0's auc: 0.82918	valid_1's binary_logloss: 0.160065	valid_1's auc: 0.823351
[3]	valid_0's binary_logloss: 0.147411	valid_0's auc: 0.836091	valid_1's binary_logloss: 0.156507	valid_1's auc: 0.828685
[4]	valid_0's binary_logloss: 0.144503	valid_0's auc: 0.840405	valid_1's binary_logloss: 0.15358	valid_1's auc: 0.833022
[5]	valid_0's binary_logloss: 0.142035	valid_0's auc: 0.843736	valid_1's binary_logloss: 0.151317	valid_1's auc: 0.835479
[6]	valid_0's binary_logloss: 0.140147	valid_0's auc: 0.844764	valid_1's binary_logloss: 0.149464	valid_1's auc: 0.836468
[7]	valid_0's binary_logloss: 0.138474	valid_0's auc: 0.847121	valid_1's binary_logloss: 0.147934	valid_1's auc: 0.836468
[8]	valid_0's binary_logloss: 0.137076	valid_0's auc: 0.847736	valid_1's binary_logloss: 0.146572	valid_1's auc: 0.837728
[9]	valid_0's binary_logloss: 0.13594	valid_0's auc: 0.848495	valid_1's binary_logloss: 0.145536	valid_1's auc: 0.838014
[10]	valid_0's binary_logloss: 0.134871	valid_0's auc: 0.850626	valid_1's binary_logloss: 0.144567	valid_1's auc: 0.838377
[11]	valid_0's binary_logloss: 0.133929	valid_0's auc: 0.851824	valid_1's binary_logloss: 0.1437	valid_1's auc: 0.83854
[12]	valid_0's binary_logloss: 0.133039	valid_0's auc: 0.853454	valid_1's binary_logloss: 0.143056	valid_1's auc: 0.839037
[13]	valid_0's binary_logloss: 0.132319	valid_0's auc: 0.854721	valid_1's binary_logloss: 0.142504	valid_1's auc: 0.838678
[14]	valid_0's binary_logloss: 0.131677	valid_0's auc: 0.85546	valid_1's binary_logloss: 0.142058	valid_1's auc: 0.838268
[15]	valid_0's binary_logloss: 0.131046	valid_0's auc: 0.856819	valid_1's binary_logloss: 0.141834	valid_1's auc: 0.837053
[16]	valid_0's binary_logloss: 0.130517	valid_0's auc: 0.857561	valid_1's binary_logloss: 0.141464	valid_1's auc: 0.83725
[17]	valid_0's binary_logloss: 0.129992	valid_0's auc: 0.858305	valid_1's binary_logloss: 0.141205	valid_1's auc: 0.837057
[18]	valid_0's binary_logloss: 0.129467	valid_0's auc: 0.859993	valid_1's binary_logloss: 0.140976	valid_1's auc: 0.836921
[19]	valid_0's binary_logloss: 0.129012	valid_0's auc: 0.86106	valid_1's binary_logloss: 0.140875	valid_1's auc: 0.83589
[20]	valid_0's binary_logloss: 0.128583	valid_0's auc: 0.862262	valid_1's binary_logloss: 0.140788	valid_1's auc: 0.83514
[21]	valid_0's binary_logloss: 0.128215	valid_0's auc: 0.863124	valid_1's binary_logloss: 0.140701	valid_1's auc: 0.834338
[22]	valid_0's binary_logloss: 0.127857	valid_0's auc: 0.864137	valid_1's binary_logloss: 0.140517	valid_1's auc: 0.834962
[23]	valid_0's binary_logloss: 0.127534	valid_0's auc: 0.864726	valid_1's binary_logloss: 0.140485	valid_1's auc: 0.834234
[24]	valid_0's binary_logloss: 0.127205	valid_0's auc: 0.865628	valid_1's binary_logloss: 0.140477	valid_1's auc: 0.833672
[25]	valid_0's binary_logloss: 0.126836	valid_0's auc: 0.866618	valid_1's binary_logloss: 0.140394	valid_1's auc: 0.833899
[26]	valid_0's binary_logloss: 0.12659	valid_0's auc: 0.867382	valid_1's binary_logloss: 0.140383	valid_1's auc: 0.833512
[27]	valid_0's binary_logloss: 0.126275	valid_0's auc: 0.868358	valid_1's binary_logloss: 0.140387	valid_1's auc: 0.833055
[28]	valid_0's binary_logloss: 0.125976	valid_0's auc: 0.869148	valid_1's binary_logloss: 0.140345	valid_1's auc: 0.832858
[29]	valid_0's binary_logloss: 0.125736	valid_0's auc: 0.869606	valid_1's binary_logloss: 0.140309	valid_1's auc: 0.832855
[30]	valid_0's binary_logloss: 0.125482	valid_0's auc: 0.870141	valid_1's binary_logloss: 0.140261	valid_1's auc: 0.83291
[31]	valid_0's binary_logloss: 0.125141	valid_0's auc: 0.871526	valid_1's binary_logloss: 0.140128	valid_1's auc: 0.833609
[32]	valid_0's binary_logloss: 0.124941	valid_0's auc: 0.871929	valid_1's binary_logloss: 0.14009	valid_1's auc: 0.833536
[33]	valid_0's binary_logloss: 0.124718	valid_0's auc: 0.872798	valid_1's binary_logloss: 0.140121	valid_1's auc: 0.833168
[34]	valid_0's binary_logloss: 0.12451	valid_0's auc: 0.873431	valid_1's binary_logloss: 0.140097	valid_1's auc: 0.833313
[35]	valid_0's binary_logloss: 0.124316	valid_0's auc: 0.873806	valid_1's binary_logloss: 0.140105	valid_1's auc: 0.833176
[36]	valid_0's binary_logloss: 0.124118	valid_0's auc: 0.874204	valid_1's binary_logloss: 0.140129	valid_1's auc: 0.833063
[37]	valid_0's binary_logloss: 0.1239	valid_0's auc: 0.874899	valid_1's binary_logloss: 0.140005	valid_1's auc: 0.83378
[38]	valid_0's binary_logloss: 0.123685	valid_0's auc: 0.875362	valid_1's binary_logloss: 0.140011	valid_1's auc: 0.833865
[39]	valid_0's binary_logloss: 0.123474	valid_0's auc: 0.875966	valid_1's binary_logloss: 0.139979	valid_1's auc: 0.833771
[40]	valid_0's binary_logloss: 0.123322	valid_0's auc: 0.876345	valid_1's binary_logloss: 0.140044	valid_1's auc: 0.833508
[41]	valid_0's binary_logloss: 0.123102	valid_0's auc: 0.876848	valid_1's binary_logloss: 0.139998	valid_1's auc: 0.833816
[42]	valid_0's binary_logloss: 0.12293	valid_0's auc: 0.877347	valid_1's binary_logloss: 0.140003	valid_1's auc: 0.833974
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.133039	valid_0's auc: 0.853454	valid_1's binary_logloss: 0.143056	valid_1's auc: 0.839037
[1]	valid_0's binary_logloss: 0.156466	valid_0's auc: 0.821831	valid_1's binary_logloss: 0.165186	valid_1's auc: 0.817525
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151107	valid_0's auc: 0.830001	valid_1's binary_logloss: 0.15968	valid_1's auc: 0.82337
[3]	valid_0's binary_logloss: 0.147324	valid_0's auc: 0.839573	valid_1's binary_logloss: 0.156063	valid_1's auc: 0.83264
[4]	valid_0's binary_logloss: 0.144391	valid_0's auc: 0.842992	valid_1's binary_logloss: 0.153143	valid_1's auc: 0.83608
[5]	valid_0's binary_logloss: 0.141966	valid_0's auc: 0.845713	valid_1's binary_logloss: 0.150779	valid_1's auc: 0.838479
[6]	valid_0's binary_logloss: 0.139952	valid_0's auc: 0.848508	valid_1's binary_logloss: 0.149011	valid_1's auc: 0.840056
[7]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.850111	valid_1's binary_logloss: 0.147468	valid_1's auc: 0.840232
[8]	valid_0's binary_logloss: 0.136906	valid_0's auc: 0.851973	valid_1's binary_logloss: 0.146195	valid_1's auc: 0.839018
[9]	valid_0's binary_logloss: 0.135643	valid_0's auc: 0.8532	valid_1's binary_logloss: 0.145217	valid_1's auc: 0.838064
[10]	valid_0's binary_logloss: 0.134586	valid_0's auc: 0.85447	valid_1's binary_logloss: 0.144268	valid_1's auc: 0.838205
[11]	valid_0's binary_logloss: 0.133674	valid_0's auc: 0.855157	valid_1's binary_logloss: 0.14353	valid_1's auc: 0.837983
[12]	valid_0's binary_logloss: 0.132856	valid_0's auc: 0.856252	valid_1's binary_logloss: 0.142891	valid_1's auc: 0.83809
[13]	valid_0's binary_logloss: 0.132111	valid_0's auc: 0.857161	valid_1's binary_logloss: 0.142263	valid_1's auc: 0.838622
[14]	valid_0's binary_logloss: 0.131389	valid_0's auc: 0.857996	valid_1's binary_logloss: 0.141727	valid_1's auc: 0.839052
[15]	valid_0's binary_logloss: 0.130739	valid_0's auc: 0.859511	valid_1's binary_logloss: 0.141355	valid_1's auc: 0.839062
[16]	valid_0's binary_logloss: 0.130175	valid_0's auc: 0.860457	valid_1's binary_logloss: 0.141072	valid_1's auc: 0.838898
[17]	valid_0's binary_logloss: 0.129656	valid_0's auc: 0.861101	valid_1's binary_logloss: 0.140731	valid_1's auc: 0.838785
[18]	valid_0's binary_logloss: 0.12915	valid_0's auc: 0.862022	valid_1's binary_logloss: 0.140433	valid_1's auc: 0.839358
[19]	valid_0's binary_logloss: 0.128659	valid_0's auc: 0.863252	valid_1's binary_logloss: 0.140181	valid_1's auc: 0.839999
[20]	valid_0's binary_logloss: 0.128254	valid_0's auc: 0.863823	valid_1's binary_logloss: 0.139974	valid_1's auc: 0.840096
[21]	valid_0's binary_logloss: 0.127855	valid_0's auc: 0.864524	valid_1's binary_logloss: 0.139827	valid_1's auc: 0.840183
[22]	valid_0's binary_logloss: 0.127461	valid_0's auc: 0.865553	valid_1's binary_logloss: 0.139714	valid_1's auc: 0.840042
[23]	valid_0's binary_logloss: 0.127109	valid_0's auc: 0.866427	valid_1's binary_logloss: 0.13974	valid_1's auc: 0.839501
[24]	valid_0's binary_logloss: 0.126769	valid_0's auc: 0.86716	valid_1's binary_logloss: 0.13959	valid_1's auc: 0.83965
[25]	valid_0's binary_logloss: 0.126454	valid_0's auc: 0.868035	valid_1's binary_logloss: 0.139583	valid_1's auc: 0.839131
[26]	valid_0's binary_logloss: 0.126125	valid_0's auc: 0.869021	valid_1's binary_logloss: 0.139492	valid_1's auc: 0.839022
[27]	valid_0's binary_logloss: 0.125839	valid_0's auc: 0.869695	valid_1's binary_logloss: 0.139453	valid_1's auc: 0.839262
[28]	valid_0's binary_logloss: 0.125557	valid_0's auc: 0.870113	valid_1's binary_logloss: 0.139366	valid_1's auc: 0.839245
[29]	valid_0's binary_logloss: 0.125297	valid_0's auc: 0.870833	valid_1's binary_logloss: 0.139358	valid_1's auc: 0.839149
[30]	valid_0's binary_logloss: 0.125018	valid_0's auc: 0.871919	valid_1's binary_logloss: 0.139376	valid_1's auc: 0.838964
[31]	valid_0's binary_logloss: 0.12476	valid_0's auc: 0.872636	valid_1's binary_logloss: 0.139326	valid_1's auc: 0.838793
[32]	valid_0's binary_logloss: 0.124553	valid_0's auc: 0.87325	valid_1's binary_logloss: 0.13928	valid_1's auc: 0.83903
[33]	valid_0's binary_logloss: 0.124351	valid_0's auc: 0.87392	valid_1's binary_logloss: 0.13927	valid_1's auc: 0.838933
[34]	valid_0's binary_logloss: 0.124137	valid_0's auc: 0.874695	valid_1's binary_logloss: 0.13921	valid_1's auc: 0.839081
[35]	valid_0's binary_logloss: 0.123965	valid_0's auc: 0.875082	valid_1's binary_logloss: 0.139215	valid_1's auc: 0.839016
[36]	valid_0's binary_logloss: 0.123737	valid_0's auc: 0.875729	valid_1's binary_logloss: 0.139225	valid_1's auc: 0.839216
[37]	valid_0's binary_logloss: 0.123474	valid_0's auc: 0.876555	valid_1's binary_logloss: 0.139239	valid_1's auc: 0.839126
Early stopping, best iteration is:
[7]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.850111	valid_1's binary_logloss: 0.147468	valid_1's auc: 0.840232
[1]	valid_0's binary_logloss: 0.156592	valid_0's auc: 0.821427	valid_1's binary_logloss: 0.165273	valid_1's auc: 0.81711
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151337	valid_0's auc: 0.827905	valid_1's binary_logloss: 0.160211	valid_1's auc: 0.82145
[3]	valid_0's binary_logloss: 0.147478	valid_0's auc: 0.837862	valid_1's binary_logloss: 0.156489	valid_1's auc: 0.828696
[4]	valid_0's binary_logloss: 0.144436	valid_0's auc: 0.840611	valid_1's binary_logloss: 0.153536	valid_1's auc: 0.831962
[5]	valid_0's binary_logloss: 0.142075	valid_0's auc: 0.843113	valid_1's binary_logloss: 0.151214	valid_1's auc: 0.834308
[6]	valid_0's binary_logloss: 0.140098	valid_0's auc: 0.84374	valid_1's binary_logloss: 0.149386	valid_1's auc: 0.834377
[7]	valid_0's binary_logloss: 0.138482	valid_0's auc: 0.845284	valid_1's binary_logloss: 0.147794	valid_1's auc: 0.835936
[8]	valid_0's binary_logloss: 0.137121	valid_0's auc: 0.847226	valid_1's binary_logloss: 0.146629	valid_1's auc: 0.836079
[9]	valid_0's binary_logloss: 0.135919	valid_0's auc: 0.850143	valid_1's binary_logloss: 0.145692	valid_1's auc: 0.835641
[10]	valid_0's binary_logloss: 0.134841	valid_0's auc: 0.851387	valid_1's binary_logloss: 0.144896	valid_1's auc: 0.835182
[11]	valid_0's binary_logloss: 0.133863	valid_0's auc: 0.852703	valid_1's binary_logloss: 0.144127	valid_1's auc: 0.835457
[12]	valid_0's binary_logloss: 0.133034	valid_0's auc: 0.854998	valid_1's binary_logloss: 0.143464	valid_1's auc: 0.836932
[13]	valid_0's binary_logloss: 0.132288	valid_0's auc: 0.856458	valid_1's binary_logloss: 0.143031	valid_1's auc: 0.836525
[14]	valid_0's binary_logloss: 0.131588	valid_0's auc: 0.857578	valid_1's binary_logloss: 0.142638	valid_1's auc: 0.836371
[15]	valid_0's binary_logloss: 0.130965	valid_0's auc: 0.858803	valid_1's binary_logloss: 0.142207	valid_1's auc: 0.836382
[16]	valid_0's binary_logloss: 0.13041	valid_0's auc: 0.859796	valid_1's binary_logloss: 0.141782	valid_1's auc: 0.836831
[17]	valid_0's binary_logloss: 0.129932	valid_0's auc: 0.860226	valid_1's binary_logloss: 0.141442	valid_1's auc: 0.837028
[18]	valid_0's binary_logloss: 0.129486	valid_0's auc: 0.861152	valid_1's binary_logloss: 0.141159	valid_1's auc: 0.837531
[19]	valid_0's binary_logloss: 0.129003	valid_0's auc: 0.862227	valid_1's binary_logloss: 0.140963	valid_1's auc: 0.837295
[20]	valid_0's binary_logloss: 0.12855	valid_0's auc: 0.863276	valid_1's binary_logloss: 0.140751	valid_1's auc: 0.837772
[21]	valid_0's binary_logloss: 0.128139	valid_0's auc: 0.864197	valid_1's binary_logloss: 0.140652	valid_1's auc: 0.837784
[22]	valid_0's binary_logloss: 0.12775	valid_0's auc: 0.865145	valid_1's binary_logloss: 0.140483	valid_1's auc: 0.837974
[23]	valid_0's binary_logloss: 0.127368	valid_0's auc: 0.865962	valid_1's binary_logloss: 0.140367	valid_1's auc: 0.837557
[24]	valid_0's binary_logloss: 0.127008	valid_0's auc: 0.866988	valid_1's binary_logloss: 0.140316	valid_1's auc: 0.837021
[25]	valid_0's binary_logloss: 0.12663	valid_0's auc: 0.868263	valid_1's binary_logloss: 0.140197	valid_1's auc: 0.837265
[26]	valid_0's binary_logloss: 0.126317	valid_0's auc: 0.868968	valid_1's binary_logloss: 0.140127	valid_1's auc: 0.836987
[27]	valid_0's binary_logloss: 0.126031	valid_0's auc: 0.869684	valid_1's binary_logloss: 0.140054	valid_1's auc: 0.837221
[28]	valid_0's binary_logloss: 0.125747	valid_0's auc: 0.870355	valid_1's binary_logloss: 0.13997	valid_1's auc: 0.837362
[29]	valid_0's binary_logloss: 0.12547	valid_0's auc: 0.871186	valid_1's binary_logloss: 0.139918	valid_1's auc: 0.837231
[30]	valid_0's binary_logloss: 0.125224	valid_0's auc: 0.871902	valid_1's binary_logloss: 0.139873	valid_1's auc: 0.837133
[31]	valid_0's binary_logloss: 0.124989	valid_0's auc: 0.872311	valid_1's binary_logloss: 0.139847	valid_1's auc: 0.83717
[32]	valid_0's binary_logloss: 0.12477	valid_0's auc: 0.872917	valid_1's binary_logloss: 0.139784	valid_1's auc: 0.837439
[33]	valid_0's binary_logloss: 0.12454	valid_0's auc: 0.873431	valid_1's binary_logloss: 0.139749	valid_1's auc: 0.837452
[34]	valid_0's binary_logloss: 0.124274	valid_0's auc: 0.874128	valid_1's binary_logloss: 0.139762	valid_1's auc: 0.837524
[35]	valid_0's binary_logloss: 0.12402	valid_0's auc: 0.874804	valid_1's binary_logloss: 0.139751	valid_1's auc: 0.837469
[36]	valid_0's binary_logloss: 0.123792	valid_0's auc: 0.875352	valid_1's binary_logloss: 0.139769	valid_1's auc: 0.83736
[37]	valid_0's binary_logloss: 0.123559	valid_0's auc: 0.87599	valid_1's binary_logloss: 0.139757	valid_1's auc: 0.837238
[38]	valid_0's binary_logloss: 0.123367	valid_0's auc: 0.876681	valid_1's binary_logloss: 0.139742	valid_1's auc: 0.837375
[39]	valid_0's binary_logloss: 0.123176	valid_0's auc: 0.877229	valid_1's binary_logloss: 0.139777	valid_1's auc: 0.837053
[40]	valid_0's binary_logloss: 0.122931	valid_0's auc: 0.877783	valid_1's binary_logloss: 0.139728	valid_1's auc: 0.837245
[41]	valid_0's binary_logloss: 0.122698	valid_0's auc: 0.878412	valid_1's binary_logloss: 0.139754	valid_1's auc: 0.837189
[42]	valid_0's binary_logloss: 0.122487	valid_0's auc: 0.879389	valid_1's binary_logloss: 0.139729	valid_1's auc: 0.837385
[43]	valid_0's binary_logloss: 0.122278	valid_0's auc: 0.879887	valid_1's binary_logloss: 0.139768	valid_1's auc: 0.83703
[44]	valid_0's binary_logloss: 0.12209	valid_0's auc: 0.880265	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.837043
[45]	valid_0's binary_logloss: 0.121908	valid_0's auc: 0.880695	valid_1's binary_logloss: 0.139671	valid_1's auc: 0.837265
[46]	valid_0's binary_logloss: 0.121712	valid_0's auc: 0.881124	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.837228
[47]	valid_0's binary_logloss: 0.121548	valid_0's auc: 0.881391	valid_1's binary_logloss: 0.139699	valid_1's auc: 0.837146
[48]	valid_0's binary_logloss: 0.121346	valid_0's auc: 0.881926	valid_1's binary_logloss: 0.139641	valid_1's auc: 0.837387
[49]	valid_0's binary_logloss: 0.121183	valid_0's auc: 0.882497	valid_1's binary_logloss: 0.13965	valid_1's auc: 0.837464
[50]	valid_0's binary_logloss: 0.121013	valid_0's auc: 0.882962	valid_1's binary_logloss: 0.139684	valid_1's auc: 0.837347
[51]	valid_0's binary_logloss: 0.120868	valid_0's auc: 0.883328	valid_1's binary_logloss: 0.139662	valid_1's auc: 0.837533
[52]	valid_0's binary_logloss: 0.12066	valid_0's auc: 0.883845	valid_1's binary_logloss: 0.139589	valid_1's auc: 0.838071
[53]	valid_0's binary_logloss: 0.120503	valid_0's auc: 0.884228	valid_1's binary_logloss: 0.139593	valid_1's auc: 0.837994
[54]	valid_0's binary_logloss: 0.120376	valid_0's auc: 0.884403	valid_1's binary_logloss: 0.139642	valid_1's auc: 0.837897
[55]	valid_0's binary_logloss: 0.120214	valid_0's auc: 0.884574	valid_1's binary_logloss: 0.139613	valid_1's auc: 0.838054
[56]	valid_0's binary_logloss: 0.120016	valid_0's auc: 0.885034	valid_1's binary_logloss: 0.139564	valid_1's auc: 0.838201
[57]	valid_0's binary_logloss: 0.119848	valid_0's auc: 0.885329	valid_1's binary_logloss: 0.139573	valid_1's auc: 0.838183
[58]	valid_0's binary_logloss: 0.119733	valid_0's auc: 0.885429	valid_1's binary_logloss: 0.139566	valid_1's auc: 0.838352
[59]	valid_0's binary_logloss: 0.119583	valid_0's auc: 0.885751	valid_1's binary_logloss: 0.139641	valid_1's auc: 0.838177
[60]	valid_0's binary_logloss: 0.119461	valid_0's auc: 0.885952	valid_1's binary_logloss: 0.139615	valid_1's auc: 0.838373
[61]	valid_0's binary_logloss: 0.119357	valid_0's auc: 0.886123	valid_1's binary_logloss: 0.139644	valid_1's auc: 0.838135
[62]	valid_0's binary_logloss: 0.119218	valid_0's auc: 0.886592	valid_1's binary_logloss: 0.139648	valid_1's auc: 0.83826
[63]	valid_0's binary_logloss: 0.11911	valid_0's auc: 0.886712	valid_1's binary_logloss: 0.139729	valid_1's auc: 0.838084
[64]	valid_0's binary_logloss: 0.119003	valid_0's auc: 0.886807	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.838391
[65]	valid_0's binary_logloss: 0.11888	valid_0's auc: 0.887021	valid_1's binary_logloss: 0.13972	valid_1's auc: 0.838343
[66]	valid_0's binary_logloss: 0.118728	valid_0's auc: 0.88734	valid_1's binary_logloss: 0.139788	valid_1's auc: 0.838004
[67]	valid_0's binary_logloss: 0.118646	valid_0's auc: 0.887341	valid_1's binary_logloss: 0.139839	valid_1's auc: 0.837935
[68]	valid_0's binary_logloss: 0.118505	valid_0's auc: 0.887601	valid_1's binary_logloss: 0.139839	valid_1's auc: 0.837981
[69]	valid_0's binary_logloss: 0.11833	valid_0's auc: 0.887954	valid_1's binary_logloss: 0.139867	valid_1's auc: 0.83787
[70]	valid_0's binary_logloss: 0.118209	valid_0's auc: 0.888114	valid_1's binary_logloss: 0.139919	valid_1's auc: 0.837718
[71]	valid_0's binary_logloss: 0.118049	valid_0's auc: 0.888481	valid_1's binary_logloss: 0.139893	valid_1's auc: 0.837821
[72]	valid_0's binary_logloss: 0.117903	valid_0's auc: 0.888835	valid_1's binary_logloss: 0.139952	valid_1's auc: 0.837731
[73]	valid_0's binary_logloss: 0.117758	valid_0's auc: 0.889134	valid_1's binary_logloss: 0.139962	valid_1's auc: 0.837899
[74]	valid_0's binary_logloss: 0.117691	valid_0's auc: 0.889144	valid_1's binary_logloss: 0.13998	valid_1's auc: 0.83792
[75]	valid_0's binary_logloss: 0.117578	valid_0's auc: 0.889275	valid_1's binary_logloss: 0.139953	valid_1's auc: 0.838045
[76]	valid_0's binary_logloss: 0.117479	valid_0's auc: 0.88948	valid_1's binary_logloss: 0.140036	valid_1's auc: 0.837718
[77]	valid_0's binary_logloss: 0.117401	valid_0's auc: 0.889549	valid_1's binary_logloss: 0.140101	valid_1's auc: 0.837554
[78]	valid_0's binary_logloss: 0.117323	valid_0's auc: 0.889594	valid_1's binary_logloss: 0.140162	valid_1's auc: 0.837358
[79]	valid_0's binary_logloss: 0.117242	valid_0's auc: 0.889725	valid_1's binary_logloss: 0.140191	valid_1's auc: 0.837296
[80]	valid_0's binary_logloss: 0.117092	valid_0's auc: 0.890095	valid_1's binary_logloss: 0.140182	valid_1's auc: 0.837436
[81]	valid_0's binary_logloss: 0.116991	valid_0's auc: 0.890237	valid_1's binary_logloss: 0.140185	valid_1's auc: 0.837617
[82]	valid_0's binary_logloss: 0.116893	valid_0's auc: 0.89035	valid_1's binary_logloss: 0.140191	valid_1's auc: 0.837676
[83]	valid_0's binary_logloss: 0.116801	valid_0's auc: 0.890464	valid_1's binary_logloss: 0.140249	valid_1's auc: 0.837537
[84]	valid_0's binary_logloss: 0.116619	valid_0's auc: 0.890869	valid_1's binary_logloss: 0.140263	valid_1's auc: 0.837565
[85]	valid_0's binary_logloss: 0.116509	valid_0's auc: 0.891174	valid_1's binary_logloss: 0.140345	valid_1's auc: 0.837241
[86]	valid_0's binary_logloss: 0.116424	valid_0's auc: 0.891255	valid_1's binary_logloss: 0.140382	valid_1's auc: 0.837141
Early stopping, best iteration is:
[56]	valid_0's binary_logloss: 0.120016	valid_0's auc: 0.885034	valid_1's binary_logloss: 0.139564	valid_1's auc: 0.838201
[1]	valid_0's binary_logloss: 0.156222	valid_0's auc: 0.824873	valid_1's binary_logloss: 0.165072	valid_1's auc: 0.817791
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151167	valid_0's auc: 0.82918	valid_1's binary_logloss: 0.160065	valid_1's auc: 0.823351
[3]	valid_0's binary_logloss: 0.147411	valid_0's auc: 0.836091	valid_1's binary_logloss: 0.156507	valid_1's auc: 0.828685
[4]	valid_0's binary_logloss: 0.144503	valid_0's auc: 0.840405	valid_1's binary_logloss: 0.15358	valid_1's auc: 0.833022
[5]	valid_0's binary_logloss: 0.142035	valid_0's auc: 0.843736	valid_1's binary_logloss: 0.151317	valid_1's auc: 0.835479
[6]	valid_0's binary_logloss: 0.140147	valid_0's auc: 0.844764	valid_1's binary_logloss: 0.149464	valid_1's auc: 0.836468
[7]	valid_0's binary_logloss: 0.138474	valid_0's auc: 0.847121	valid_1's binary_logloss: 0.147934	valid_1's auc: 0.836468
[8]	valid_0's binary_logloss: 0.137076	valid_0's auc: 0.847736	valid_1's binary_logloss: 0.146572	valid_1's auc: 0.837728
[9]	valid_0's binary_logloss: 0.13594	valid_0's auc: 0.848495	valid_1's binary_logloss: 0.145536	valid_1's auc: 0.838014
[10]	valid_0's binary_logloss: 0.134871	valid_0's auc: 0.850626	valid_1's binary_logloss: 0.144567	valid_1's auc: 0.838377
[11]	valid_0's binary_logloss: 0.133929	valid_0's auc: 0.851824	valid_1's binary_logloss: 0.1437	valid_1's auc: 0.83854
[12]	valid_0's binary_logloss: 0.133039	valid_0's auc: 0.853454	valid_1's binary_logloss: 0.143056	valid_1's auc: 0.839037
[13]	valid_0's binary_logloss: 0.132319	valid_0's auc: 0.854721	valid_1's binary_logloss: 0.142504	valid_1's auc: 0.838678
[14]	valid_0's binary_logloss: 0.131677	valid_0's auc: 0.85546	valid_1's binary_logloss: 0.142058	valid_1's auc: 0.838268
[15]	valid_0's binary_logloss: 0.131046	valid_0's auc: 0.856819	valid_1's binary_logloss: 0.141834	valid_1's auc: 0.837053
[16]	valid_0's binary_logloss: 0.130517	valid_0's auc: 0.857561	valid_1's binary_logloss: 0.141464	valid_1's auc: 0.83725
[17]	valid_0's binary_logloss: 0.129992	valid_0's auc: 0.858305	valid_1's binary_logloss: 0.141205	valid_1's auc: 0.837057
[18]	valid_0's binary_logloss: 0.129467	valid_0's auc: 0.859993	valid_1's binary_logloss: 0.140976	valid_1's auc: 0.836921
[19]	valid_0's binary_logloss: 0.129012	valid_0's auc: 0.86106	valid_1's binary_logloss: 0.140875	valid_1's auc: 0.83589
[20]	valid_0's binary_logloss: 0.128583	valid_0's auc: 0.862262	valid_1's binary_logloss: 0.140788	valid_1's auc: 0.83514
[21]	valid_0's binary_logloss: 0.128215	valid_0's auc: 0.863124	valid_1's binary_logloss: 0.140701	valid_1's auc: 0.834338
[22]	valid_0's binary_logloss: 0.127857	valid_0's auc: 0.864137	valid_1's binary_logloss: 0.140517	valid_1's auc: 0.834962
[23]	valid_0's binary_logloss: 0.127534	valid_0's auc: 0.864726	valid_1's binary_logloss: 0.140485	valid_1's auc: 0.834234
[24]	valid_0's binary_logloss: 0.127205	valid_0's auc: 0.865628	valid_1's binary_logloss: 0.140477	valid_1's auc: 0.833672
[25]	valid_0's binary_logloss: 0.126836	valid_0's auc: 0.866618	valid_1's binary_logloss: 0.140394	valid_1's auc: 0.833899
[26]	valid_0's binary_logloss: 0.12659	valid_0's auc: 0.867382	valid_1's binary_logloss: 0.140383	valid_1's auc: 0.833512
[27]	valid_0's binary_logloss: 0.126275	valid_0's auc: 0.868358	valid_1's binary_logloss: 0.140387	valid_1's auc: 0.833055
[28]	valid_0's binary_logloss: 0.125976	valid_0's auc: 0.869148	valid_1's binary_logloss: 0.140345	valid_1's auc: 0.832858
[29]	valid_0's binary_logloss: 0.125736	valid_0's auc: 0.869606	valid_1's binary_logloss: 0.140309	valid_1's auc: 0.832855
[30]	valid_0's binary_logloss: 0.125482	valid_0's auc: 0.870141	valid_1's binary_logloss: 0.140261	valid_1's auc: 0.83291
[31]	valid_0's binary_logloss: 0.125141	valid_0's auc: 0.871526	valid_1's binary_logloss: 0.140128	valid_1's auc: 0.833609
[32]	valid_0's binary_logloss: 0.124941	valid_0's auc: 0.871929	valid_1's binary_logloss: 0.14009	valid_1's auc: 0.833536
[33]	valid_0's binary_logloss: 0.124718	valid_0's auc: 0.872798	valid_1's binary_logloss: 0.140121	valid_1's auc: 0.833168
[34]	valid_0's binary_logloss: 0.12451	valid_0's auc: 0.873431	valid_1's binary_logloss: 0.140097	valid_1&##39;s auc: 0.833313
[35]	valid_0's binary_logloss: 0.124316	valid_0's auc: 0.873806	valid_1's binary_logloss: 0.140105	valid_1's auc: 0.833176
[36]	valid_0's binary_logloss: 0.124118	valid_0's auc: 0.874204	valid_1's binary_logloss: 0.140129	valid_1's auc: 0.833063
[37]	valid_0's binary_logloss: 0.1239	valid_0's auc: 0.874899	valid_1's binary_logloss: 0.140005	valid_1's auc: 0.83378
[38]	valid_0's binary_logloss: 0.123685	valid_0's auc: 0.875362	valid_1's binary_logloss: 0.140011	valid_1's auc: 0.833865
[39]	valid_0's binary_logloss: 0.123474	valid_0's auc: 0.875966	valid_1's binary_logloss: 0.139979	valid_1's auc: 0.833771
[40]	valid_0's binary_logloss: 0.123322	valid_0's auc: 0.876345	valid_1's binary_logloss: 0.140044	valid_1's auc: 0.833508
[41]	valid_0's binary_logloss: 0.123102	valid_0's auc: 0.876848	valid_1's binary_logloss: 0.139998	valid_1's auc: 0.833816
[42]	valid_0's binary_logloss: 0.12293	valid_0's auc: 0.877347	valid_1's binary_logloss: 0.140003	valid_1's auc: 0.833974
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.133039	valid_0's auc: 0.853454	valid_1's binary_logloss: 0.143056	valid_1's auc: 0.839037
[1]	valid_0's binary_logloss: 0.156466	valid_0's auc: 0.821831	valid_1's binary_logloss: 0.165186	valid_1's auc: 0.817525
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151107	valid_0's auc: 0.830001	valid_1's binary_logloss: 0.15968	valid_1's auc: 0.82337
[3]	valid_0's binary_logloss: 0.147324	valid_0's auc: 0.839573	valid_1's binary_logloss: 0.156063	valid_1's auc: 0.83264
[4]	valid_0's binary_logloss: 0.144391	valid_0's auc: 0.842992	valid_1's binary_logloss: 0.153143	valid_1's auc: 0.83608
[5]	valid_0's binary_logloss: 0.141966	valid_0's auc: 0.845713	valid_1's binary_logloss: 0.150779	valid_1's auc: 0.838479
[6]	valid_0's binary_logloss: 0.139952	valid_0's auc: 0.848508	valid_1's binary_logloss: 0.149011	valid_1's auc: 0.840056
[7]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.850111	valid_1's binary_logloss: 0.147468	valid_1's auc: 0.840232
[8]	valid_0's binary_logloss: 0.136906	valid_0's auc: 0.851973	valid_1's binary_logloss: 0.146195	valid_1's auc: 0.839018
[9]	valid_0's binary_logloss: 0.135643	valid_0's auc: 0.8532	valid_1's binary_logloss: 0.145217	valid_1's auc: 0.838064
[10]	valid_0's binary_logloss: 0.134586	valid_0's auc: 0.85447	valid_1's binary_logloss: 0.144268	valid_1's auc: 0.838205
[11]	valid_0's binary_logloss: 0.133674	valid_0's auc: 0.855157	valid_1's binary_logloss: 0.14353	valid_1's auc: 0.837983
[12]	valid_0's binary_logloss: 0.132856	valid_0's auc: 0.856252	valid_1's binary_logloss: 0.142891	valid_1's auc: 0.83809
[13]	valid_0's binary_logloss: 0.132111	valid_0's auc: 0.857161	valid_1's binary_logloss: 0.142263	valid_1's auc: 0.838622
[14]	valid_0's binary_logloss: 0.131389	valid_0's auc: 0.857996	valid_1's binary_logloss: 0.141727	valid_1's auc: 0.839052
[15]	valid_0's binary_logloss: 0.130739	valid_0's auc: 0.859511	valid_1's binary_logloss: 0.141355	valid_1's auc: 0.839062
[16]	valid_0's binary_logloss: 0.130175	valid_0's auc: 0.860457	valid_1's binary_logloss: 0.141072	valid_1's auc: 0.838898
[17]	valid_0's binary_logloss: 0.129656	valid_0's auc: 0.861101	valid_1's binary_logloss: 0.140731	valid_1's auc: 0.838785
[18]	valid_0's binary_logloss: 0.12915	valid_0's auc: 0.862022	valid_1's binary_logloss: 0.140433	valid_1's auc: 0.839358
[19]	valid_0's binary_logloss: 0.128659	valid_0's auc: 0.863252	valid_1's binary_logloss: 0.140181	valid_1's auc: 0.839999
[20]	valid_0's binary_logloss: 0.128254	valid_0's auc: 0.863823	valid_1's binary_logloss: 0.139974	valid_1's auc: 0.840096
[21]	valid_0's binary_logloss: 0.127855	valid_0's auc: 0.864524	valid_1's binary_logloss: 0.139827	valid_1's auc: 0.840183
[22]	valid_0's binary_logloss: 0.127461	valid_0's auc: 0.865553	valid_1's binary_logloss: 0.139714	valid_1's auc: 0.840042
[23]	valid_0's binary_logloss: 0.127109	valid_0's auc: 0.866427	valid_1's binary_logloss: 0.13974	valid_1's auc: 0.839501
[24]	valid_0's binary_logloss: 0.126769	valid_0's auc: 0.86716	valid_1's binary_logloss: 0.13959	valid_1's auc: 0.83965
[25]	valid_0's binary_logloss: 0.126454	valid_0's auc: 0.868035	valid_1's binary_logloss: 0.139583	valid_1's auc: 0.839131
[26]	valid_0's binary_logloss: 0.126125	valid_0's auc: 0.869021	valid_1's binary_logloss: 0.139492	valid_1's auc: 0.839022
[27]	valid_0's binary_logloss: 0.125839	valid_0's auc: 0.869695	valid_1's binary_logloss: 0.139453	valid_1's auc: 0.839262
[28]	valid_0's binary_logloss: 0.125557	valid_0's auc: 0.870113	valid_1's binary_logloss: 0.139366	valid_1's auc: 0.839245
[29]	valid_0's binary_logloss: 0.125297	valid_0's auc: 0.870833	valid_1's binary_logloss: 0.139358	valid_1's auc: 0.839149
[30]	valid_0's binary_logloss: 0.125018	valid_0's auc: 0.871919	valid_1's binary_logloss: 0.139376	valid_1's auc: 0.838964
[31]	valid_0's binary_logloss: 0.12476	valid_0's auc: 0.872636	valid_1's binary_logloss: 0.139326	valid_1's auc: 0.838793
[32]	valid_0's binary_logloss: 0.124553	valid_0's auc: 0.87325	valid_1's binary_logloss: 0.13928	valid_1's auc: 0.83903
[33]	valid_0's binary_logloss: 0.124351	valid_0's auc: 0.87392	valid_1's binary_logloss: 0.13927	valid_1's auc: 0.838933
[34]	valid_0's binary_logloss: 0.124137	valid_0's auc: 0.874695	valid_1's binary_logloss: 0.13921	valid_1's auc: 0.839081
[35]	valid_0's binary_logloss: 0.123965	valid_0's auc: 0.875082	valid_1's binary_logloss: 0.139215	valid_1's auc: 0.839016
[36]	valid_0's binary_logloss: 0.123737	valid_0's auc: 0.875729	valid_1's binary_logloss: 0.139225	valid_1's auc: 0.839216
[37]	valid_0's binary_logloss: 0.123474	valid_0's auc: 0.876555	valid_1's binary_logloss: 0.139239	valid_1's auc: 0.839126
Early stopping, best iteration is:
[7]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.850111	valid_1's binary_logloss: 0.147468	valid_1's auc: 0.840232
[1]	valid_0's binary_logloss: 0.156592	valid_0's auc: 0.821427	valid_1's binary_logloss: 0.165273	valid_1's auc: 0.81711
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151337	valid_0's auc: 0.827905	valid_1's binary_logloss: 0.160211	valid_1's auc: 0.82145
[3]	valid_0's binary_logloss: 0.147478	valid_0's auc: 0.837862	valid_1's binary_logloss: 0.156489	valid_1's auc: 0.828696
[4]	valid_0's binary_logloss: 0.144436	valid_0's auc: 0.840611	valid_1's binary_logloss: 0.153536	valid_1's auc: 0.831962
[5]	valid_0's binary_logloss: 0.142075	valid_0's auc: 0.843113	valid_1's binary_logloss: 0.151214	valid_1's auc: 0.834308
[6]	valid_0's binary_logloss: 0.140098	valid_0's auc: 0.84374	valid_1's binary_logloss: 0.149386	valid_1's auc: 0.834377
[7]	valid_0's binary_logloss: 0.138482	valid_0's auc: 0.845284	valid_1's binary_logloss: 0.147794	valid_1's auc: 0.835936
[8]	valid_0's binary_logloss: 0.137121	valid_0's auc: 0.847226	valid_1's binary_logloss: 0.146629	valid_1's auc: 0.836079
[9]	valid_0's binary_logloss: 0.135919	valid_0's auc: 0.850143	valid_1's binary_logloss: 0.145692	valid_1's auc: 0.835641
[10]	valid_0's binary_logloss: 0.134841	valid_0's auc: 0.851387	valid_1's binary_logloss: 0.144896	valid_1's auc: 0.835182
[11]	valid_0's binary_logloss: 0.133863	valid_0's auc: 0.852703	valid_1's binary_logloss: 0.144127	valid_1's auc: 0.835457
[12]	valid_0's binary_logloss: 0.133034	valid_0's auc: 0.854998	valid_1's binary_logloss: 0.143464	valid_1's auc: 0.836932
[13]	valid_0's binary_logloss: 0.132288	valid_0's auc: 0.856458	valid_1's binary_logloss: 0.143031	valid_1's auc: 0.836525
[14]	valid_0's binary_logloss: 0.131588	valid_0's auc: 0.857578	valid_1's binary_logloss: 0.142638	valid_1's auc: 0.836371
[15]	valid_0's binary_logloss: 0.130965	valid_0's auc: 0.858803	valid_1's binary_logloss: 0.142207	valid_1's auc: 0.836382
[16]	valid_0's binary_logloss: 0.13041	valid_0's auc: 0.859796	valid_1's binary_logloss: 0.141782	valid_1's auc: 0.836831
[17]	valid_0's binary_logloss: 0.129932	valid_0's auc: 0.860226	valid_1's binary_logloss: 0.141442	valid_1's auc: 0.837028
[18]	valid_0's binary_logloss: 0.129486	valid_0's auc: 0.861152	valid_1's binary_logloss: 0.141159	valid_1's auc: 0.837531
[19]	valid_0's binary_logloss: 0.129003	valid_0's auc: 0.862227	valid_1's binary_logloss: 0.140963	valid_1's auc: 0.837295
[20]	valid_0's binary_logloss: 0.12855	valid_0's auc: 0.863276	valid_1's binary_logloss: 0.140751	valid_1's auc: 0.837772
[21]	valid_0's binary_logloss: 0.128139	valid_0's auc: 0.864197	valid_1's binary_logloss: 0.140652	valid_1's auc: 0.837784
[22]	valid_0's binary_logloss: 0.12775	valid_0's auc: 0.865145	valid_1's binary_logloss: 0.140483	valid_1's auc: 0.837974
[23]	valid_0's binary_logloss: 0.127368	valid_0's auc: 0.865962	valid_1's binary_logloss: 0.140367	valid_1's auc: 0.837557
[24]	valid_0's binary_logloss: 0.127008	valid_0's auc: 0.866988	valid_1's binary_logloss: 0.140316	valid_1's auc: 0.837021
[25]	valid_0's binary_logloss: 0.12663	valid_0's auc: 0.868263	valid_1's binary_logloss: 0.140197	valid_1's auc: 0.837265
[26]	valid_0's binary_logloss: 0.126317	valid_0's auc: 0.868968	valid_1's binary_logloss: 0.140127	valid_1's auc: 0.836987
[27]	valid_0's binary_logloss: 0.126031	valid_0's auc: 0.869684	valid_1's binary_logloss: 0.140054	valid_1's auc: 0.837221
[28]	valid_0's binary_logloss: 0.125747	valid_0's auc: 0.870355	valid_1's binary_logloss: 0.13997	valid_1's auc: 0.837362
[29]	valid_0's binary_logloss: 0.12547	valid_0's auc: 0.871186	valid_1's binary_logloss: 0.139918	valid_1's auc: 0.837231
[30]	valid_0's binary_logloss: 0.125224	valid_0's auc: 0.871902	valid_1's binary_logloss: 0.139873	valid_1's auc: 0.837133
[31]	valid_0's binary_logloss: 0.124989	valid_0's auc: 0.872311	valid_1's binary_logloss: 0.139847	valid_1's auc: 0.83717
[32]	valid_0's binary_logloss: 0.12477	valid_0's auc: 0.872917	valid_1's binary_logloss: 0.139784	valid_1's auc: 0.837439
[33]	valid_0's binary_logloss: 0.12454	valid_0's auc: 0.873431	valid_1's binary_logloss: 0.139749	valid_1's auc: 0.837452
[34]	valid_0's binary_logloss: 0.124274	valid_0's auc: 0.874128	valid_1's binary_logloss: 0.139762	valid_1's auc: 0.837524
[35]	valid_0's binary_logloss: 0.12402	valid_0's auc: 0.874804	valid_1's binary_logloss: 0.139751	valid_1's auc: 0.837469
[36]	valid_0's binary_logloss: 0.123792	valid_0's auc: 0.875352	valid_1's binary_logloss: 0.139769	valid_1's auc: 0.83736
[37]	valid_0's binary_logloss: 0.123559	valid_0's auc: 0.87599	valid_1's binary_logloss: 0.139757	valid_1's auc: 0.837238
[38]	valid_0's binary_logloss: 0.123367	valid_0's auc: 0.876681	valid_1's binary_logloss: 0.139742	valid_1's auc: 0.837375
[39]	valid_0's binary_logloss: 0.123176	valid_0's auc: 0.877229	valid_1's binary_logloss: 0.139777	valid_1's auc: 0.837053
[40]	valid_0's binary_logloss: 0.122931	valid_0's auc: 0.877783	valid_1's binary_logloss: 0.139728	valid_1's auc: 0.837245
[41]	valid_0's binary_logloss: 0.122698	valid_0's auc: 0.878412	valid_1's binary_logloss: 0.139754	valid_1's auc: 0.837189
[42]	valid_0's binary_logloss: 0.122487	valid_0's auc: 0.879389	valid_1's binary_logloss: 0.139729	valid_1's auc: 0.837385
[43]	valid_0's binary_logloss: 0.122278	valid_0's auc: 0.879887	valid_1's binary_logloss: 0.139768	valid_1's auc: 0.83703
[44]	valid_0's binary_logloss: 0.12209	valid_0's auc: 0.880265	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.837043
[45]	valid_0's binary_logloss: 0.121908	valid_0's auc: 0.880695	valid_1's binary_logloss: 0.139671	valid_1's auc: 0.837265
[46]	valid_0's binary_logloss: 0.121712	valid_0's auc: 0.881124	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.837228
[47]	valid_0's binary_logloss: 0.121548	valid_0's auc: 0.881391	valid_1's binary_logloss: 0.139699	valid_1's auc: 0.837146
[48]	valid_0's binary_logloss: 0.121346	valid_0's auc: 0.881926	valid_1's binary_logloss: 0.139641	valid_1's auc: 0.837387
[49]	valid_0's binary_logloss: 0.121183	valid_0's auc: 0.882497	valid_1's binary_logloss: 0.13965	valid_1's auc: 0.837464
[50]	valid_0's binary_logloss: 0.121013	valid_0's auc: 0.882962	valid_1's binary_logloss: 0.139684	valid_1's auc: 0.837347
[51]	valid_0's binary_logloss: 0.120868	valid_0's auc: 0.883328	valid_1's binary_logloss: 0.139662	valid_1's auc: 0.837533
[52]	valid_0's binary_logloss: 0.12066	valid_0's auc: 0.883845	valid_1's binary_logloss: 0.139589	valid_1's auc: 0.838071
[53]	valid_0's binary_logloss: 0.120503	valid_0's auc: 0.884228	valid_1's binary_logloss: 0.139593	valid_1's auc: 0.837994
[54]	valid_0's binary_logloss: 0.120376	valid_0's auc: 0.884403	valid_1's binary_logloss: 0.139642	valid_1's auc: 0.837897
[55]	valid_0's binary_logloss: 0.120214	valid_0's auc: 0.884574	valid_1's binary_logloss: 0.139613	valid_1's auc: 0.838054
[56]	valid_0's binary_logloss: 0.120016	valid_0's auc: 0.885034	valid_1's binary_logloss: 0.139564	valid_1's auc: 0.838201
[57]	valid_0's binary_logloss: 0.119848	valid_0's auc: 0.885329	valid_1's binary_logloss: 0.139573	valid_1's auc: 0.838183
[58]	valid_0's binary_logloss: 0.119733	valid_0's auc: 0.885429	valid_1's binary_logloss: 0.139566	valid_1's auc: 0.838352
[59]	valid_0's binary_logloss: 0.119583	valid_0's auc: 0.885751	valid_1's binary_logloss: 0.139641	valid_1's auc: 0.838177
[60]	valid_0's binary_logloss: 0.119461	valid_0's auc: 0.885952	valid_1's binary_logloss: 0.139615	valid_1's auc: 0.838373
[61]	valid_0's binary_logloss: 0.119357	valid_0's auc: 0.886123	valid_1's binary_logloss: 0.139644	valid_1's auc: 0.838135
[62]	valid_0's binary_logloss: 0.119218	valid_0's auc: 0.886592	valid_1's binary_logloss: 0.139648	valid_1's auc: 0.83826
[63]	valid_0's binary_logloss: 0.11911	valid_0's auc: 0.886712	valid_1's binary_logloss: 0.139729	valid_1's auc: 0.838084
[64]	valid_0's binary_logloss: 0.119003	valid_0's auc: 0.886807	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.838391
[65]	valid_0's binary_logloss: 0.11888	valid_0's auc: 0.887021	valid_1's binary_logloss: 0.13972	valid_1's auc: 0.838343
[66]	valid_0's binary_logloss: 0.118728	valid_0's auc: 0.88734	valid_1's binary_logloss: 0.139788	valid_1's auc: 0.838004
[67]	valid_0's binary_logloss: 0.118646	valid_0's auc: 0.887341	valid_1's binary_logloss: 0.139839	valid_1's auc: 0.837935
[68]	valid_0's binary_logloss: 0.118505	valid_0's auc: 0.887601	valid_1's binary_logloss: 0.139839	valid_1's auc: 0.837981
[69]	valid_0's binary_logloss: 0.11833	valid_0's auc: 0.887954	valid_1's binary_logloss: 0.139867	valid_1's auc: 0.83787
[70]	valid_0's binary_logloss: 0.118209	valid_0's auc: 0.888114	valid_1's binary_logloss: 0.139919	valid_1's auc: 0.837718
[71]	valid_0's binary_logloss: 0.118049	valid_0's auc: 0.888481	valid_1's binary_logloss: 0.139893	valid_1's auc: 0.837821
[72]	valid_0's binary_logloss: 0.117903	valid_0's auc: 0.888835	valid_1's binary_logloss: 0.139952	valid_1's auc: 0.837731
[73]	valid_0's binary_logloss: 0.117758	valid_0's auc: 0.889134	valid_1's binary_logloss: 0.139962	valid_1's auc: 0.837899
[74]	valid_0's binary_logloss: 0.117691	valid_0's auc: 0.889144	valid_1's binary_logloss: 0.13998	valid_1's auc: 0.83792
[75]	valid_0's binary_logloss: 0.117578	valid_0's auc: 0.889275	valid_1's binary_logloss: 0.139953	valid_1's auc: 0.838045
[76]	valid_0's binary_logloss: 0.117479	valid_0's auc: 0.88948	valid_1's binary_logloss: 0.140036	valid_1's auc: 0.837718
[77]	valid_0's binary_logloss: 0.117401	valid_0's auc: 0.889549	valid_1's binary_logloss: 0.140101	valid_1's auc: 0.837554
[78]	valid_0's binary_logloss: 0.117323	valid_0's auc: 0.889594	valid_1's binary_logloss: 0.140162	valid_1's auc: 0.837358
[79]	valid_0's binary_logloss: 0.117242	valid_0's auc: 0.889725	valid_1's binary_logloss: 0.140191	valid_1's auc: 0.837296
[80]	valid_0's binary_logloss: 0.117092	valid_0's auc: 0.890095	valid_1's binary_logloss: 0.140182	valid_1's auc: 0.837436
[81]	valid_0's binary_logloss: 0.116991	valid_0's auc: 0.890237	valid_1's binary_logloss: 0.140185	valid_1's auc: 0.837617
[82]	valid_0's binary_logloss: 0.116893	valid_0's auc: 0.89035	valid_1's binary_logloss: 0.140191	valid_1's auc: 0.837676
[83]	valid_0's binary_logloss: 0.116801	valid_0's auc: 0.890464	valid_1's binary_logloss: 0.140249	valid_1's auc: 0.837537
[84]	valid_0's binary_logloss: 0.116619	valid_0's auc: 0.890869	valid_1's binary_logloss: 0.140263	valid_1's auc: 0.837565
[85]	valid_0's binary_logloss: 0.116509	valid_0's auc: 0.891174	valid_1's binary_logloss: 0.140345	valid_1's auc: 0.837241
[86]	valid_0's binary_logloss: 0.116424	valid_0's auc: 0.891255	valid_1's binary_logloss: 0.140382	valid_1's auc: 0.837141
Early stopping, best iteration is:
[56]	valid_0's binary_logloss: 0.120016	valid_0's auc: 0.885034	valid_1's binary_logloss: 0.139564	valid_1's auc: 0.838201
[1]	valid_0's binary_logloss: 0.155721	valid_0's auc: 0.835412	valid_1's binary_logloss: 0.164844	valid_1's auc: 0.81973
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150324	valid_0's auc: 0.841215	valid_1's binary_logloss: 0.159859	valid_1's auc: 0.823632
[3]	valid_0's binary_logloss: 0.146303	valid_0's auc: 0.846402	valid_1's binary_logloss: 0.156265	valid_1's auc: 0.824432
[4]	valid_0's binary_logloss: 0.143141	valid_0's auc: 0.851123	valid_1's binary_logloss: 0.153379	valid_1's auc: 0.830341
[5]	valid_0's binary_logloss: 0.140571	valid_0's auc: 0.853991	valid_1's binary_logloss: 0.151129	valid_1's auc: 0.831329
[6]	valid_0's binary_logloss: 0.138389	valid_0's auc: 0.856674	valid_1's binary_logloss: 0.149272	valid_1's auc: 0.833102
[7]	valid_0's binary_logloss: 0.136551	valid_0's auc: 0.858444	valid_1's binary_logloss: 0.14779	valid_1's auc: 0.833757
[8]	valid_0's binary_logloss: 0.135038	valid_0's auc: 0.859496	valid_1's binary_logloss: 0.146518	valid_1's auc: 0.834435
[9]	valid_0's binary_logloss: 0.133585	valid_0's auc: 0.861389	valid_1's binary_logloss: 0.145534	valid_1's auc: 0.834629
[10]	valid_0's binary_logloss: 0.132396	valid_0's auc: 0.863665	valid_1's binary_logloss: 0.144698	valid_1's auc: 0.834967
[11]	valid_0's binary_logloss: 0.13134	valid_0's auc: 0.865337	valid_1's binary_logloss: 0.144026	valid_1's auc: 0.835265
[12]	valid_0's binary_logloss: 0.130312	valid_0's auc: 0.86681	valid_1's binary_logloss: 0.143395	valid_1's auc: 0.835596
[13]	valid_0's binary_logloss: 0.129392	valid_0's auc: 0.868736	valid_1's binary_logloss: 0.142859	valid_1's auc: 0.835221
[14]	valid_0's binary_logloss: 0.128555	valid_0's auc: 0.870248	valid_1's binary_logloss: 0.142419	valid_1's auc: 0.835178
[15]	valid_0's binary_logloss: 0.127833	valid_0's auc: 0.87138	valid_1's binary_logloss: 0.14216	valid_1's auc: 0.834834
[16]	valid_0's binary_logloss: 0.127151	valid_0's auc: 0.872373	valid_1's binary_logloss: 0.141863	valid_1's auc: 0.834648
[17]	valid_0's binary_logloss: 0.126561	valid_0's auc: 0.873016	valid_1's binary_logloss: 0.141838	valid_1's auc: 0.83334
[18]	valid_0's binary_logloss: 0.125944	valid_0's auc: 0.874082	valid_1's binary_logloss: 0.141517	valid_1's auc: 0.833668
[19]	valid_0's binary_logloss: 0.125371	valid_0's auc: 0.875136	valid_1's binary_logloss: 0.141507	valid_1's auc: 0.832742
[20]	valid_0's binary_logloss: 0.124814	valid_0's auc: 0.876197	valid_1's binary_logloss: 0.141376	valid_1's auc: 0.832569
[21]	valid_0's binary_logloss: 0.124265	valid_0's auc: 0.877286	valid_1's binary_logloss: 0.141369	valid_1's auc: 0.831531
[22]	valid_0's binary_logloss: 0.12376	valid_0's auc: 0.878351	valid_1's binary_logloss: 0.141291	valid_1's auc: 0.831493
[23]	valid_0's binary_logloss: 0.123252	valid_0's auc: 0.87915	valid_1's binary_logloss: 0.141173	valid_1's auc: 0.831944
[24]	valid_0's binary_logloss: 0.122817	valid_0's auc: 0.88009	valid_1's binary_logloss: 0.141183	valid_1's auc: 0.831531
[25]	valid_0's binary_logloss: 0.12235	valid_0's auc: 0.881183	valid_1's binary_logloss: 0.141142	valid_1's auc: 0.831519
[26]	valid_0's binary_logloss: 0.121911	valid_0's auc: 0.882242	valid_1's binary_logloss: 0.141125	valid_1's auc: 0.83122
[27]	valid_0's binary_logloss: 0.121503	valid_0's auc: 0.882894	valid_1's binary_logloss: 0.141169	valid_1's auc: 0.830821
[28]	valid_0's binary_logloss: 0.121051	valid_0's auc: 0.883863	valid_1's binary_logloss: 0.141164	valid_1's auc: 0.830774
[29]	valid_0's binary_logloss: 0.12066	valid_0's auc: 0.884664	valid_1's binary_logloss: 0.141239	valid_1's auc: 0.830255
[30]	valid_0's binary_logloss: 0.120322	valid_0's auc: 0.885346	valid_1's binary_logloss: 0.141355	valid_1's auc: 0.829487
[31]	valid_0's binary_logloss: 0.119914	valid_0's auc: 0.88669	valid_1's binary_logloss: 0.141339	valid_1's auc: 0.829648
[32]	valid_0's binary_logloss: 0.119542	valid_0's auc: 0.887524	valid_1's binary_logloss: 0.14135	valid_1's auc: 0.829315
[33]	valid_0's binary_logloss: 0.119183	valid_0's auc: 0.888251	valid_1's binary_logloss: 0.141344	valid_1's auc: 0.82931
[34]	valid_0's binary_logloss: 0.118927	valid_0's auc: 0.888706	valid_1's binary_logloss: 0.141416	valid_1's auc: 0.829105
[35]	valid_0's binary_logloss: 0.118593	valid_0's auc: 0.889307	valid_1's binary_logloss: 0.141513	valid_1's auc: 0.828734
[36]	valid_0's binary_logloss: 0.11827	valid_0's auc: 0.890033	valid_1's binary_logloss: 0.141387	valid_1's auc: 0.829267
[37]	valid_0's binary_logloss: 0.11791	valid_0's auc: 0.890794	valid_1's binary_logloss: 0.141414	valid_1's auc: 0.829028
[38]	valid_0's binary_logloss: 0.11759	valid_0's auc: 0.891883	valid_1's binary_logloss: 0.141499	valid_1's auc: 0.828809
[39]	valid_0's binary_logloss: 0.117294	valid_0's auc: 0.892363	valid_1's binary_logloss: 0.141556	valid_1's auc: 0.828552
[40]	valid_0's binary_logloss: 0.117026	valid_0's auc: 0.89279	valid_1's binary_logloss: 0.141604	valid_1's auc: 0.828434
[41]	valid_0's binary_logloss: 0.116765	valid_0's auc: 0.893455	valid_1's binary_logloss: 0.141573	valid_1's auc: 0.828598
[42]	valid_0's binary_logloss: 0.116515	valid_0's auc: 0.893797	valid_1's binary_logloss: 0.1416	valid_1's auc: 0.828463
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.130312	valid_0's auc: 0.86681	valid_1's binary_logloss: 0.143395	valid_1's auc: 0.835596
[1]	valid_0's binary_logloss: 0.155928	valid_0's auc: 0.830474	valid_1's binary_logloss: 0.164928	valid_1's auc: 0.817343
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150276	valid_0's auc: 0.842991	valid_1's binary_logloss: 0.159411	valid_1's auc: 0.827907
[3]	valid_0's binary_logloss: 0.146251	valid_0's auc: 0.851825	valid_1's binary_logloss: 0.155739	valid_1's auc: 0.832413
[4]	valid_0's binary_logloss: 0.143091	valid_0's auc: 0.854455	valid_1's binary_logloss: 0.15282	valid_1's auc: 0.833987
[5]	valid_0's binary_logloss: 0.140521	valid_0's auc: 0.857038	valid_1's binary_logloss: 0.150456	valid_1's auc: 0.836024
[6]	valid_0's binary_logloss: 0.138303	valid_0's auc: 0.859784	valid_1's binary_logloss: 0.148558	valid_1's auc: 0.836565
[7]	valid_0's binary_logloss: 0.13638	valid_0's auc: 0.861991	valid_1's binary_logloss: 0.147071	valid_1's auc: 0.837355
[8]	valid_0's binary_logloss: 0.134702	valid_0's auc: 0.863742	valid_1's binary_logloss: 0.145789	valid_1's auc: 0.837366
[9]	valid_0's binary_logloss: 0.1333	valid_0's auc: 0.865288	valid_1's binary_logloss: 0.144676	valid_1's auc: 0.838092
[10]	valid_0's binary_logloss: 0.132065	valid_0's auc: 0.866558	valid_1's binary_logloss: 0.143753	valid_1's auc: 0.838732
[11]	valid_0's binary_logloss: 0.131005	valid_0's auc: 0.867378	valid_1's binary_logloss: 0.142985	valid_1's auc: 0.838939
[12]	valid_0's binary_logloss: 0.130046	valid_0's auc: 0.868402	valid_1's binary_logloss: 0.142418	valid_1's auc: 0.837922
[13]	valid_0's binary_logloss: 0.12914	valid_0's auc: 0.869713	valid_1's binary_logloss: 0.141868	valid_1's auc: 0.838282
[14]	valid_0's binary_logloss: 0.128307	valid_0's auc: 0.870702	valid_1's binary_logloss: 0.141374	valid_1's auc: 0.838019
[15]	valid_0's binary_logloss: 0.127523	valid_0's auc: 0.871975	valid_1's binary_logloss: 0.140933	valid_1's auc: 0.83802
[16]	valid_0's binary_logloss: 0.126793	valid_0's auc: 0.873071	valid_1's binary_logloss: 0.140591	valid_1's auc: 0.838163
[17]	valid_0's binary_logloss: 0.126108	valid_0's auc: 0.874334	valid_1's binary_logloss: 0.140362	valid_1's auc: 0.837716
[18]	valid_0's binary_logloss: 0.125531	valid_0's auc: 0.875627	valid_1's binary_logloss: 0.140249	valid_1's auc: 0.836977
[19]	valid_0's binary_logloss: 0.124919	valid_0's auc: 0.876957	valid_1's binary_logloss: 0.140038	valid_1's auc: 0.837445
[20]	valid_0's binary_logloss: 0.124384	valid_0's auc: 0.877892	valid_1's binary_logloss: 0.139918	valid_1's auc: 0.837849
[21]	valid_0's binary_logloss: 0.12384	valid_0's auc: 0.878874	valid_1's binary_logloss: 0.139882	valid_1's auc: 0.837238
[22]	valid_0's binary_logloss: 0.123266	valid_0's auc: 0.880326	valid_1's binary_logloss: 0.139792	valid_1's auc: 0.836997
[23]	valid_0's binary_logloss: 0.122729	valid_0's auc: 0.881582	valid_1's binary_logloss: 0.139713	valid_1's auc: 0.83712
[24]	valid_0's binary_logloss: 0.122317	valid_0's auc: 0.882456	valid_1's binary_logloss: 0.139557	valid_1's auc: 0.837621
[25]	valid_0's binary_logloss: 0.121815	valid_0's auc: 0.883646	valid_1's binary_logloss: 0.139517	valid_1's auc: 0.837461
[26]	valid_0's binary_logloss: 0.12134	valid_0's auc: 0.884752	valid_1's binary_logloss: 0.139402	valid_1's auc: 0.837924
[27]	valid_0's binary_logloss: 0.120926	valid_0's auc: 0.885706	valid_1's binary_logloss: 0.139415	valid_1's auc: 0.837521
[28]	valid_0's binary_logloss: 0.12049	valid_0's auc: 0.886476	valid_1's binary_logloss: 0.139392	valid_1's auc: 0.837391
[29]	valid_0's binary_logloss: 0.120092	valid_0's auc: 0.887401	valid_1's binary_logloss: 0.139389	valid_1's auc: 0.837142
[30]	valid_0's binary_logloss: 0.119653	valid_0's auc: 0.88847	valid_1's binary_logloss: 0.139427	valid_1's auc: 0.837007
[31]	valid_0's binary_logloss: 0.119235	valid_0's auc: 0.889406	valid_1's binary_logloss: 0.13934	valid_1's auc: 0.837386
[32]	valid_0's binary_logloss: 0.118854	valid_0's auc: 0.890464	valid_1's binary_logloss: 0.139395	valid_1's auc: 0.836872
[33]	valid_0's binary_logloss: 0.118486	valid_0's auc: 0.891323	valid_1's binary_logloss: 0.139445	valid_1's auc: 0.836772
[34]	valid_0's binary_logloss: 0.118123	valid_0's auc: 0.892149	valid_1's binary_logloss: 0.139504	valid_1's auc: 0.836389
[35]	valid_0's binary_logloss: 0.117793	valid_0's auc: 0.892998	valid_1's binary_logloss: 0.139533	valid_1's auc: 0.836255
[36]	valid_0's binary_logloss: 0.117478	valid_0's auc: 0.89356	valid_1's binary_logloss: 0.139523	valid_1's auc: 0.836322
[37]	valid_0's binary_logloss: 0.117177	valid_0's auc: 0.894086	valid_1's binary_logloss: 0.13956	valid_1's auc: 0.836152
[38]	valid_0's binary_logloss: 0.116796	valid_0's auc: 0.894901	valid_1's binary_logloss: 0.139585	valid_1's auc: 0.836268
[39]	valid_0's binary_logloss: 0.116504	valid_0's auc: 0.895733	valid_1's binary_logloss: 0.139544	valid_1's auc: 0.836498
[40]	valid_0's binary_logloss: 0.116196	valid_0's auc: 0.896306	valid_1's binary_logloss: 0.139553	valid_1's auc: 0.836675
[41]	valid_0's binary_logloss: 0.115849	valid_0's auc: 0.897067	valid_1's binary_logloss: 0.139607	valid_1's auc: 0.83661
Early stopping, best iteration is:
[11]	valid_0's binary_logloss: 0.131005	valid_0's auc: 0.867378	valid_1's binary_logloss: 0.142985	valid_1's auc: 0.838939
[1]	valid_0's binary_logloss: 0.15607	valid_0's auc: 0.834724	valid_1's binary_logloss: 0.165104	valid_1's auc: 0.822983
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150505	valid_0's auc: 0.842399	valid_1's binary_logloss: 0.159789	valid_1's auc: 0.82874
[3]	valid_0's binary_logloss: 0.146325	valid_0's auc: 0.847465	valid_1's binary_logloss: 0.155994	valid_1's auc: 0.830964
[4]	valid_0's binary_logloss: 0.14313	valid_0's auc: 0.850024	valid_1's binary_logloss: 0.153168	valid_1's auc: 0.831698
[5]	valid_0's binary_logloss: 0.140492	valid_0's auc: 0.853487	valid_1's binary_logloss: 0.150751	valid_1's auc: 0.834088
[6]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.855865	valid_1's binary_logloss: 0.148857	valid_1's auc: 0.834424
[7]	valid_0's binary_logloss: 0.136482	valid_0's auc: 0.857298	valid_1's binary_logloss: 0.147407	valid_1's auc: 0.835442
[8]	valid_0's binary_logloss: 0.134832	valid_0's auc: 0.858957	valid_1's binary_logloss: 0.146173	valid_1's auc: 0.835673
[9]	valid_0's binary_logloss: 0.133462	valid_0's auc: 0.861749	valid_1's binary_logloss: 0.145247	valid_1's auc: 0.835295
[10]	valid_0's binary_logloss: 0.132297	valid_0's auc: 0.863187	valid_1's binary_logloss: 0.144397	valid_1's auc: 0.835558
[11]	valid_0's binary_logloss: 0.131209	valid_0's auc: 0.86518	valid_1's binary_logloss: 0.143714	valid_1's auc: 0.835465
[12]	valid_0's binary_logloss: 0.130224	valid_0's auc: 0.866937	valid_1's binary_logloss: 0.143043	valid_1's auc: 0.835379
[13]	valid_0's binary_logloss: 0.129241	valid_0's auc: 0.869703	valid_1's binary_logloss: 0.142451	valid_1's auc: 0.836269
[14]	valid_0's binary_logloss: 0.128427	valid_0's auc: 0.870923	valid_1's binary_logloss: 0.142023	valid_1's auc: 0.836369
[15]	valid_0's binary_logloss: 0.127649	valid_0's auc: 0.872259	valid_1's binary_logloss: 0.141652	valid_1's auc: 0.836264
[16]	valid_0's binary_logloss: 0.126903	valid_0's auc: 0.873489	valid_1's binary_logloss: 0.141407	valid_1's auc: 0.836069
[17]	valid_0's binary_logloss: 0.126262	valid_0's auc: 0.874492	valid_1's binary_logloss: 0.141126	valid_1's auc: 0.836201
[18]	valid_0's binary_logloss: 0.125627	valid_0's auc: 0.87595	valid_1's binary_logloss: 0.140886	valid_1's auc: 0.83635
[19]	valid_0's binary_logloss: 0.125013	valid_0's auc: 0.877131	valid_1's binary_logloss: 0.140739	valid_1's auc: 0.836076
[20]	valid_0's binary_logloss: 0.124466	valid_0's auc: 0.878085	valid_1's binary_logloss: 0.140566	valid_1's auc: 0.83617
[21]	valid_0's binary_logloss: 0.123852	valid_0's auc: 0.879486	valid_1's binary_logloss: 0.140435	valid_1's auc: 0.836204
[22]	valid_0's binary_logloss: 0.123297	valid_0's auc: 0.880587	valid_1's binary_logloss: 0.140314	valid_1's auc: 0.836447
[23]	valid_0's binary_logloss: 0.122794	valid_0's auc: 0.881726	valid_1's binary_logloss: 0.140303	valid_1's auc: 0.836098
[24]	valid_0's binary_logloss: 0.122314	valid_0's auc: 0.882711	valid_1's binary_logloss: 0.140219	valid_1's auc: 0.83633
[25]	valid_0's binary_logloss: 0.121852	valid_0's auc: 0.883523	valid_1's binary_logloss: 0.140159	valid_1's auc: 0.836558
[26]	valid_0's binary_logloss: 0.121425	valid_0's auc: 0.88437	valid_1's binary_logloss: 0.140016	valid_1's auc: 0.83683
[27]	valid_0's binary_logloss: 0.120914	valid_0's auc: 0.885636	valid_1's binary_logloss: 0.13996	valid_1's auc: 0.836819
[28]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.886325	valid_1's binary_logloss: 0.139864	valid_1's auc: 0.837376
[29]	valid_0's binary_logloss: 0.120163	valid_0's auc: 0.887055	valid_1's binary_logloss: 0.139938	valid_1's auc: 0.836929
[30]	valid_0's binary_logloss: 0.119761	valid_0's auc: 0.887923	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.836813
[31]	valid_0's binary_logloss: 0.11938	valid_0's auc: 0.888783	valid_1's binary_logloss: 0.139954	valid_1's auc: 0.836207
[32]	valid_0's binary_logloss: 0.118999	valid_0's auc: 0.889881	valid_1's binary_logloss: 0.139895	valid_1's auc: 0.836409
[33]	valid_0's binary_logloss: 0.118666	valid_0's auc: 0.890577	valid_1's binary_logloss: 0.139943	valid_1's auc: 0.836063
[34]	valid_0's binary_logloss: 0.118351	valid_0's auc: 0.891155	valid_1's binary_logloss: 0.139964	valid_1's auc: 0.836137
[35]	valid_0's binary_logloss: 0.118001	valid_0's auc: 0.891785	valid_1's binary_logloss: 0.139945	valid_1's auc: 0.836228
[36]	valid_0's binary_logloss: 0.117642	valid_0's auc: 0.89242	valid_1's binary_logloss: 0.139981	valid_1's auc: 0.836019
[37]	valid_0's binary_logloss: 0.117331	valid_0's auc: 0.893202	valid_1's binary_logloss: 0.140014	valid_1's auc: 0.835858
[38]	valid_0's binary_logloss: 0.117028	valid_0's auc: 0.893881	valid_1's binary_logloss: 0.140116	valid_1's auc: 0.835594
[39]	valid_0's binary_logloss: 0.11671	valid_0's auc: 0.89439	valid_1's binary_logloss: 0.140166	valid_1's auc: 0.8355
[40]	valid_0's binary_logloss: 0.116439	valid_0's auc: 0.894767	valid_1's binary_logloss: 0.140175	valid_1's auc: 0.835564
[41]	valid_0's binary_logloss: 0.116161	valid_0's auc: 0.895261	valid_1's binary_logloss: 0.140228	valid_1's auc: 0.835399
[42]	valid_0's binary_logloss: 0.115888	valid_0's auc: 0.895782	valid_1's binary_logloss: 0.14032	valid_1's auc: 0.835369
[43]	valid_0's binary_logloss: 0.115655	valid_0's auc: 0.895994	valid_1's binary_logloss: 0.140379	valid_1's auc: 0.835382
[44]	valid_0's binary_logloss: 0.115426	valid_0's auc: 0.896287	valid_1's binary_logloss: 0.140406	valid_1's auc: 0.835169
[45]	valid_0's binary_logloss: 0.115148	valid_0's auc: 0.896767	valid_1's binary_logloss: 0.140418	valid_1's auc: 0.835223
[46]	valid_0's binary_logloss: 0.114846	valid_0's auc: 0.897406	valid_1's binary_logloss: 0.140402	valid_1's auc: 0.835554
[47]	valid_0's binary_logloss: 0.114594	valid_0's auc: 0.897922	valid_1's binary_logloss: 0.140445	valid_1's auc: 0.835407
[48]	valid_0's binary_logloss: 0.114317	valid_0's auc: 0.898413	valid_1's binary_logloss: 0.140451	valid_1's auc: 0.835472
[49]	valid_0's binary_logloss: 0.114115	valid_0's auc: 0.89881	valid_1's binary_logloss: 0.14045	valid_1's auc: 0.835652
[50]	valid_0's binary_logloss: 0.113872	valid_0's auc: 0.89913	valid_1's binary_logloss: 0.1405	valid_1's auc: 0.835727
[51]	valid_0's binary_logloss: 0.113635	valid_0's auc: 0.899546	valid_1's binary_logloss: 0.140435	valid_1's auc: 0.836189
[52]	valid_0's binary_logloss: 0.113446	valid_0's auc: 0.899796	valid_1's binary_logloss: 0.140412	valid_1's auc: 0.836528
[53]	valid_0's binary_logloss: 0.113287	valid_0's auc: 0.899848	valid_1's binary_logloss: 0.140511	valid_1's auc: 0.836191
[54]	valid_0's binary_logloss: 0.113006	valid_0's auc: 0.900303	valid_1's binary_logloss: 0.140619	valid_1's auc: 0.835867
[55]	valid_0's binary_logloss: 0.112738	valid_0's auc: 0.900788	valid_1's binary_logloss: 0.140716	valid_1's auc: 0.835597
[56]	valid_0's binary_logloss: 0.112563	valid_0's auc: 0.900867	valid_1's binary_logloss: 0.140731	valid_1's auc: 0.835775
[57]	valid_0's binary_logloss: 0.112423	valid_0's auc: 0.900882	valid_1's binary_logloss: 0.140747	valid_1's auc: 0.835795
[58]	valid_0's binary_logloss: 0.112179	valid_0's auc: 0.901235	valid_1's binary_logloss: 0.140809	valid_1's auc: 0.835782
Early stopping, best iteration is:
[28]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.886325	valid_1's binary_logloss: 0.139864	valid_1's auc: 0.837376
[1]	valid_0's binary_logloss: 0.155721	valid_0's auc: 0.835412	valid_1's binary_logloss: 0.164844	valid_1's auc: 0.81973
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150324	valid_0's auc: 0.841215	valid_1's binary_logloss: 0.159859	valid_1's auc: 0.823632
[3]	valid_0's binary_logloss: 0.146303	valid_0's auc: 0.846402	valid_1's binary_logloss: 0.156265	valid_1's auc: 0.824432
[4]	valid_0's binary_logloss: 0.143141	valid_0's auc: 0.851123	valid_1's binary_logloss: 0.153379	valid_1's auc: 0.830341
[5]	valid_0's binary_logloss: 0.140571	valid_0's auc: 0.853991	valid_1's binary_logloss: 0.151129	valid_1's auc: 0.831329
[6]	valid_0's binary_logloss: 0.138389	valid_0's auc: 0.856674	valid_1's binary_logloss: 0.149272	valid_1's auc: 0.833102
[7]	valid_0's binary_logloss: 0.136551	valid_0's auc: 0.858444	valid_1's binary_logloss: 0.14779	valid_1's auc: 0.833757
[8]	valid_0's binary_logloss: 0.135038	valid_0's auc: 0.859496	valid_1's binary_logloss: 0.146518	valid_1's auc: 0.834435
[9]	valid_0's binary_logloss: 0.133585	valid_0's auc: 0.861389	valid_1's binary_logloss: 0.145534	valid_1's auc: 0.834629
[10]	valid_0's binary_logloss: 0.132396	valid_0's auc: 0.863665	valid_1's binary_logloss: 0.144698	valid_1's auc: 0.834967
[11]	valid_0's binary_logloss: 0.13134	valid_0's auc: 0.865337	valid_1's binary_logloss: 0.144026	valid_1's auc: 0.835265
[12]	valid_0's binary_logloss: 0.130312	valid_0's auc: 0.86681	valid_1's binary_logloss: 0.143395	valid_1's auc: 0.835596
[13]	valid_0's binary_logloss: 0.129392	valid_0's auc: 0.868736	valid_1's binary_logloss: 0.142859	valid_1's auc: 0.835221
[14]	valid_0's binary_logloss: 0.128555	valid_0's auc: 0.870248	valid_1's binary_logloss: 0.142419	valid_1's auc: 0.835178
[15]	valid_0's binary_logloss: 0.127833	valid_0's auc: 0.87138	valid_1's binary_logloss: 0.14216	valid_1's auc: 0.834834
[16]	valid_0's binary_logloss: 0.127151	valid_0's auc: 0.872373	valid_1's binary_logloss: 0.141863	valid_1's auc: 0.834648
[17]	valid_0's binary_logloss: 0.126561	valid_0's auc: 0.873016	valid_1's binary_logloss: 0.141838	valid_1's auc: 0.83334
[18]	valid_0's binary_logloss: 0.125944	valid_0's auc: 0.874082	valid_1's binary_logloss: 0.141517	valid_1's auc: 0.833668
[19]	valid_0's binary_logloss: 0.125371	valid_0's auc: 0.875136	valid_1's binary_logloss: 0.141507	valid_1's auc: 0.832742
[20]	valid_0's binary_logloss: 0.124814	valid_0's auc: 0.876197	valid_1's binary_logloss: 0.141376	valid_1's auc: 0.832569
[21]	valid_0's binary_logloss: 0.124265	valid_0's auc: 0.877286	valid_1's binary_logloss: 0.141369	valid_1's auc: 0.831531
[22]	valid_0's binary_logloss: 0.12376	valid_0's auc: 0.878351	valid_1's binary_logloss: 0.141291	valid_1's auc: 0.831493
[23]	valid_0's binary_logloss: 0.123252	valid_0's auc: 0.87915	valid_1's binary_logloss: 0.141173	valid_1's auc: 0.831944
[24]	valid_0's binary_logloss: 0.122817	valid_0's auc: 0.88009	valid_1's binary_logloss: 0.141183	valid_1's auc: 0.831531
[25]	valid_0's binary_logloss: 0.12235	valid_0's auc: 0.881183	valid_1's binary_logloss: 0.141142	valid_1's auc: 0.831519
[26]	valid_0's binary_logloss: 0.121911	valid_0's auc: 0.882242	valid_1's binary_logloss: 0.141125	valid_1's auc: 0.83122
[27]	valid_0's binary_logloss: 0.121503	valid_0's auc: 0.882894	valid_1's binary_logloss: 0.141169	valid_1's auc: 0.830821
[28]	valid_0's binary_logloss: 0.121051	valid_0's auc: 0.883863	valid_1's binary_logloss: 0.141164	valid_1's auc: 0.830774
[29]	valid_0's binary_logloss: 0.12066	valid_0's auc: 0.884664	valid_1's binary_logloss: 0.141239	valid_1's auc: 0.830255
[30]	valid_0's binary_logloss: 0.120322	valid_0's auc: 0.885346	valid_1's binary_logloss: 0.141355	valid_1's auc: 0.829487
[31]	valid_0's binary_logloss: 0.119914	valid_0's auc: 0.88669	valid_1's binary_logloss: 0.141339	valid_1's auc: 0.829648
[32]	valid_0's binary_logloss: 0.119542	valid_0's auc: 0.887524	valid_1's binary_logloss: 0.14135	valid_1's auc: 0.829315
[33]	valid_0's binary_logloss: 0.119183	valid_0's auc: 0.888251	valid_1's binary_logloss: 0.141344	valid_1's auc: 0.82931
[34]	valid_0's binary_logloss: 0.118927	valid_0's auc: 0.888706	valid_1's binary_logloss: 0.141416	valid_1's auc: 0.829105
[35]	valid_0's binary_logloss: 0.118593	valid_0's auc: 0.889307	valid_1's binary_logloss: 0.141513	valid_1's auc: 0.828734
[36]	valid_0's binary_logloss: 0.11827	valid_0's auc: 0.890033	valid_1's binary_logloss: 0.141387	valid_1's auc: 0.829267
[37]	valid_0's binary_logloss: 0.11791	valid_0's auc: 0.890794	valid_1's binary_logloss: 0.141414	valid_1's auc: 0.829028
[38]	valid_0's binary_logloss: 0.11759	valid_0's auc: 0.891883	valid_1's binary_logloss: 0.141499	valid_1's auc: 0.828809
[39]	valid_0's binary_logloss: 0.117294	valid_0's auc: 0.892363	valid_1's binary_logloss: 0.141556	valid_1's auc: 0.828552
[40]	valid_0's binary_logloss: 0.117026	valid_0's auc: 0.89279	valid_1's binary_logloss: 0.141604	valid_1's auc: 0.828434
[41]	valid_0's binary_logloss: 0.116765	valid_0's auc: 0.893455	valid_1's binary_logloss: 0.141573	valid_1's auc: 0.828598
[42]	valid_0's binary_logloss: 0.116515	valid_0's auc: 0.893797	valid_1's binary_logloss: 0.1416	valid_1's auc: 0.828463
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.130312	valid_0's auc: 0.86681	valid_1's binary_logloss: 0.143395	valid_1's auc: 0.835596
[1]	valid_0's binary_logloss: 0.155928	valid_0's auc: 0.830474	valid_1's binary_logloss: 0.164928	valid_1's auc: 0.817343
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150276	valid_0's auc: 0.842991	valid_1's binary_logloss: 0.159411	valid_1's auc: 0.827907
[3]	valid_0's binary_logloss: 0.146251	valid_0's auc: 0.851825	valid_1's binary_logloss: 0.155739	valid_1's auc: 0.832413
[4]	valid_0's binary_logloss: 0.143091	valid_0's auc: 0.854455	valid_1's binary_logloss: 0.15282	valid_1's auc: 0.833987
[5]	valid_0's binary_logloss: 0.140521	valid_0's auc: 0.857038	valid_1's binary_logloss: 0.150456	valid_1's auc: 0.836024
[6]	valid_0's binary_logloss: 0.138303	valid_0's auc: 0.859784	valid_1's binary_logloss: 0.148558	valid_1's auc: 0.836565
[7]	valid_0's binary_logloss: 0.13638	valid_0's auc: 0.861991	valid_1's binary_logloss: 0.147071	valid_1's auc: 0.837355
[8]	valid_0's binary_logloss: 0.134702	valid_0's auc: 0.863742	valid_1's binary_logloss: 0.145789	valid_1's auc: 0.837366
[9]	valid_0's binary_logloss: 0.1333	valid_0's auc: 0.865288	valid_1's binary_logloss: 0.144676	valid_1's auc: 0.838092
[10]	valid_0's binary_logloss: 0.132065	valid_0's auc: 0.866558	valid_1's binary_logloss: 0.143753	valid_1's auc: 0.838732
[11]	valid_0's binary_logloss: 0.131005	valid_0's auc: 0.867378	valid_1's binary_logloss: 0.142985	valid_1's auc: 0.838939
[12]	valid_0's binary_logloss: 0.130046	valid_0's auc: 0.868402	valid_1's binary_logloss: 0.142418	valid_1's auc: 0.837922
[13]	valid_0's binary_logloss: 0.12914	valid_0's auc: 0.869713	valid_1's binary_logloss: 0.141868	valid_1's auc: 0.838282
[14]	valid_0's binary_logloss: 0.128307	valid_0's auc: 0.870702	valid_1's binary_logloss: 0.141374	valid_1's auc: 0.838019
[15]	valid_0's binary_logloss: 0.127523	valid_0's auc: 0.871975	valid_1's binary_logloss: 0.140933	valid_1's auc: 0.83802
[16]	valid_0's binary_logloss: 0.126793	valid_0's auc: 0.873071	valid_1's binary_logloss: 0.140591	valid_1's auc: 0.838163
[17]	valid_0's binary_logloss: 0.126108	valid_0's auc: 0.874334	valid_1's binary_logloss: 0.140362	valid_1's auc: 0.837716
[18]	valid_0's binary_logloss: 0.125531	valid_0's auc: 0.875627	valid_1's binary_logloss: 0.140249	valid_1's auc: 0.836977
[19]	valid_0's binary_logloss: 0.124919	valid_0's auc: 0.876957	valid_1's binary_logloss: 0.140038	valid_1's auc: 0.837445
[20]	valid_0's binary_logloss: 0.124384	valid_0's auc: 0.877892	valid_1's binary_logloss: 0.139918	valid_1's auc: 0.837849
[21]	valid_0's binary_logloss: 0.12384	valid_0's auc: 0.878874	valid_1's binary_logloss: 0.139882	valid_1's auc: 0.837238
[22]	valid_0's binary_logloss: 0.123266	valid_0's auc: 0.880326	valid_1's binary_logloss: 0.139792	valid_1's auc: 0.836997
[23]	valid_0's binary_logloss: 0.122729	valid_0's auc: 0.881582	valid_1's binary_logloss: 0.139713	valid_1's auc: 0.83712
[24]	valid_0's binary_logloss: 0.122317	valid_0's auc: 0.882456	valid_1's binary_logloss: 0.139557	valid_1's auc: 0.837621
[25]	valid_0's binary_logloss: 0.121815	valid_0's auc: 0.883646	valid_1's binary_logloss: 0.139517	valid_1's auc: 0.837461
[26]	valid_0's binary_logloss: 0.12134	valid_0's auc: 0.884752	valid_1's binary_logloss: 0.139402	valid_1's auc: 0.837924
[27]	valid_0's binary_logloss: 0.120926	valid_0's auc: 0.885706	valid_1's binary_logloss: 0.139415	valid_1's auc: 0.837521
[28]	valid_0's binary_logloss: 0.12049	valid_0's auc: 0.886476	valid_1's binary_logloss: 0.139392	valid_1's auc: 0.837391
[29]	valid_0's binary_logloss: 0.120092	valid_0's auc: 0.887401	valid_1's binary_logloss: 0.139389	valid_1's auc: 0.837142
[30]	valid_0's binary_logloss: 0.119653	valid_0's auc: 0.88847	valid_1's binary_logloss: 0.139427	valid_1's auc: 0.837007
[31]	valid_0's binary_logloss: 0.119235	valid_0's auc: 0.889406	valid_1's binary_logloss: 0.13934	valid_1's auc: 0.837386
[32]	valid_0's binary_logloss: 0.118854	valid_0's auc: 0.890464	valid_1's binary_logloss: 0.139395	valid_1's auc: 0.836872
[33]	valid_0's binary_logloss: 0.118486	valid_0's auc: 0.891323	valid_1's binary_logloss: 0.139445	valid_1's auc: 0.836772
[34]	valid_0's binary_logloss: 0.118123	valid_0's auc: 0.892149	valid_1's binary_logloss: 0.139504	valid_1's auc: 0.836389
[35]	valid_0's binary_logloss: 0.117793	valid_0's auc: 0.892998	valid_1's binary_logloss: 0.139533	valid_1's auc: 0.836255
[36]	valid_0's binary_logloss: 0.117478	valid_0's auc: 0.89356	valid_1's binary_logloss: 0.139523	valid_1's auc: 0.836322
[37]	valid_0's binary_logloss: 0.117177	valid_0's auc: 0.894086	valid_1's binary_logloss: 0.13956	valid_1's auc: 0.836152
[38]	valid_0's binary_logloss: 0.116796	valid_0's auc: 0.894901	valid_1's binary_logloss: 0.139585	valid_1's auc: 0.836268
[39]	valid_0's binary_logloss: 0.116504	valid_0's auc: 0.895733	valid_1's binary_logloss: 0.139544	valid_1's auc: 0.836498
[40]	valid_0's binary_logloss: 0.116196	valid_0's auc: 0.896306	valid_1's binary_logloss: 0.139553	valid_1's auc: 0.836675
[41]	valid_0's binary_logloss: 0.115849	valid_0's auc: 0.897067	valid_1's binary_logloss: 0.139607	valid_1's auc: 0.83661
Early stopping, best iteration is:
[11]	valid_0's binary_logloss: 0.131005	valid_0's auc: 0.867378	valid_1's binary_logloss: 0.142985	valid_1's auc: 0.838939
[1]	valid_0's binary_logloss: 0.15607	valid_0's auc: 0.834724	valid_1's binary_logloss: 0.165104	valid_1's auc: 0.822983
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150505	valid_0's auc: 0.842399	valid_1's binary_logloss: 0.159789	valid_1's auc: 0.82874
[3]	valid_0's binary_logloss: 0.146325	valid_0's auc: 0.847465	valid_1's binary_logloss: 0.155994	valid_1's auc: 0.830964
[4]	valid_0's binary_logloss: 0.14313	valid_0's auc: 0.850024	valid_1's binary_logloss: 0.153168	valid_1's auc: 0.831698
[5]	valid_0's binary_logloss: 0.140492	valid_0's auc: 0.853487	valid_1's binary_logloss: 0.150751	valid_1's auc: 0.834088
[6]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.855865	valid_1's binary_logloss: 0.148857	valid_1's auc: 0.834424
[7]	valid_0's binary_logloss: 0.136482	valid_0's auc: 0.857298	valid_1's binary_logloss: 0.147407	valid_1's auc: 0.835442
[8]	valid_0's binary_logloss: 0.134832	valid_0's auc: 0.858957	valid_1's binary_logloss: 0.146173	valid_1's auc: 0.835673
[9]	valid_0's binary_logloss: 0.133462	valid_0's auc: 0.861749	valid_1's binary_logloss: 0.145247	valid_1's auc: 0.835295
[10]	valid_0's binary_logloss: 0.132297	valid_0's auc: 0.863187	valid_1's binary_logloss: 0.144397	valid_1's auc: 0.835558
[11]	valid_0's binary_logloss: 0.131209	valid_0's auc: 0.86518	valid_1's binary_logloss: 0.143714	valid_1's auc: 0.835465
[12]	valid_0's binary_logloss: 0.130224	valid_0's auc: 0.866937	valid_1's binary_logloss: 0.143043	valid_1's auc: 0.835379
[13]	valid_0's binary_logloss: 0.129241	valid_0's auc: 0.869703	valid_1's binary_logloss: 0.142451	valid_1's auc: 0.836269
[14]	valid_0's binary_logloss: 0.128427	valid_0's auc: 0.870923	valid_1's binary_logloss: 0.142023	valid_1's auc: 0.836369
[15]	valid_0's binary_logloss: 0.127649	valid_0's auc: 0.872259	valid_1's binary_logloss: 0.141652	valid_1's auc: 0.836264
[16]	valid_0's binary_logloss: 0.126903	valid_0's auc: 0.873489	valid_1's binary_logloss: 0.141407	valid_1's auc: 0.836069
[17]	valid_0's binary_logloss: 0.126262	valid_0's auc: 0.874492	valid_1's binary_logloss: 0.141126	valid_1's auc: 0.836201
[18]	valid_0's binary_logloss: 0.125627	valid_0's auc: 0.87595	valid_1's binary_logloss: 0.140886	valid_1's auc: 0.83635
[19]	valid_0's binary_logloss: 0.125013	valid_0's auc: 0.877131	valid_1's binary_logloss: 0.140739	valid_1's auc: 0.836076
[20]	valid_0's binary_logloss: 0.124466	valid_0's auc: 0.878085	valid_1's binary_logloss: 0.140566	valid_1's auc: 0.83617
[21]	valid_0's binary_logloss: 0.123852	valid_0's auc: 0.879486	valid_1's binary_logloss: 0.140435	valid_1's auc: 0.836204
[22]	valid_0's binary_logloss: 0.123297	valid_0's auc: 0.880587	valid_1's binary_logloss: 0.140314	valid_1's auc: 0.836447
[23]	valid_0's binary_logloss: 0.122794	valid_0's auc: 0.881726	valid_1's binary_logloss: 0.140303	valid_1's auc: 0.836098
[24]	valid_0's binary_logloss: 0.122314	valid_0's auc: 0.882711	valid_1's binary_logloss: 0.140219	valid_1's auc: 0.83633
[25]	valid_0's binary_logloss: 0.121852	valid_0's auc: 0.883523	valid_1's binary_logloss: 0.140159	valid_1's auc: 0.836558
[26]	valid_0's binary_logloss: 0.121425	valid_0's auc: 0.88437	valid_1's binary_logloss: 0.140016	valid_1's auc: 0.83683
[27]	valid_0's binary_logloss: 0.120914	valid_0's auc: 0.885636	valid_1's binary_logloss: 0.13996	valid_1's auc: 0.836819
[28]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.886325	valid_1's binary_logloss: 0.139864	valid_1's auc: 0.837376
[29]	valid_0's binary_logloss: 0.120163	valid_0's auc: 0.887055	valid_1's binary_logloss: 0.139938	valid_1's auc: 0.836929
[30]	valid_0's binary_logloss: 0.119761	valid_0's auc: 0.887923	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.836813
[31]	valid_0's binary_logloss: 0.11938	valid_0's auc: 0.888783	valid_1's binary_logloss: 0.139954	valid_1's auc: 0.836207
[32]	valid_0's binary_logloss: 0.118999	valid_0's auc: 0.889881	valid_1's binary_logloss: 0.139895	valid_1's auc: 0.836409
[33]	valid_0's binary_logloss: 0.118666	valid_0's auc: 0.890577	valid_1's binary_logloss: 0.139943	valid_1's auc: 0.836063
[34]	valid_0's binary_logloss: 0.118351	valid_0's auc: 0.891155	valid_1's binary_logloss: 0.139964	valid_1's auc: 0.836137
[35]	valid_0's binary_logloss: 0.118001	valid_0's auc: 0.891785	valid_1's binary_logloss: 0.139945	valid_1's auc: 0.836228
[36]	valid_0's binary_logloss: 0.117642	valid_0's auc: 0.89242	valid_1's binary_logloss: 0.139981	valid_1's auc: 0.836019
[37]	valid_0's binary_logloss: 0.117331	valid_0's auc: 0.893202	valid_1's binary_logloss: 0.140014	valid_1's auc: 0.835858
[38]	valid_0's binary_logloss: 0.117028	valid_0's auc: 0.893881	valid_1's binary_logloss: 0.140116	valid_1's auc: 0.835594
[39]	valid_0's binary_logloss: 0.11671	valid_0's auc: 0.89439	valid_1's binary_logloss: 0.140166	valid_1's auc: 0.8355
[40]	valid_0's binary_logloss: 0.116439	valid_0's auc: 0.894767	valid_1's binary_logloss: 0.140175	valid_1's auc: 0.835564
[41]	valid_0's binary_logloss: 0.116161	valid_0's auc: 0.895261	valid_1's binary_logloss: 0.140228	valid_1's auc: 0.835399
[42]	valid_0's binary_logloss: 0.115888	valid_0's auc: 0.895782	valid_1's binary_logloss: 0.14032	valid_1's auc: 0.835369
[43]	valid_0's binary_logloss: 0.115655	valid_0's auc: 0.895994	valid_1's binary_logloss: 0.140379	valid_1's auc: 0.835382
[44]	valid_0's binary_logloss: 0.115426	valid_0's auc: 0.896287	valid_1's binary_logloss: 0.140406	valid_1's auc: 0.835169
[45]	valid_0's binary_logloss: 0.115148	valid_0's auc: 0.896767	valid_1's binary_logloss: 0.140418	valid_1's auc: 0.835223
[46]	valid_0's binary_logloss: 0.114846	valid_0's auc: 0.897406	valid_1's binary_logloss: 0.140402	valid_1's auc: 0.835554
[47]	valid_0's binary_logloss: 0.114594	valid_0's auc: 0.897922	valid_1's binary_logloss: 0.140445	valid_1's auc: 0.835407
[48]	valid_0's binary_logloss: 0.114317	valid_0's auc: 0.898413	valid_1's binary_logloss: 0.140451	valid_1's auc: 0.835472
[49]	valid_0's binary_logloss: 0.114115	valid_0's auc: 0.89881	valid_1's binary_logloss: 0.14045	valid_1's auc: 0.835652
[50]	valid_0's binary_logloss: 0.113872	valid_0's auc: 0.89913	valid_1's binary_logloss: 0.1405	valid_1's auc: 0.835727
[51]	valid_0's binary_logloss: 0.113635	valid_0's auc: 0.899546	valid_1's binary_logloss: 0.140435	valid_1's auc: 0.836189
[52]	valid_0's binary_logloss: 0.113446	valid_0's auc: 0.899796	valid_1's binary_logloss: 0.140412	valid_1's auc: 0.836528
[53]	valid_0's binary_logloss: 0.113287	valid_0's auc: 0.899848	valid_1's binary_logloss: 0.140511	valid_1's auc: 0.836191
[54]	valid_0's binary_logloss: 0.113006	valid_0's auc: 0.900303	valid_1's binary_logloss: 0.140619	valid_1's auc: 0.835867
[55]	valid_0's binary_logloss: 0.112738	valid_0's auc: 0.900788	valid_1's binary_logloss: 0.140716	valid_1's auc: 0.835597
[56]	valid_0's binary_logloss: 0.112563	valid_0's auc: 0.900867	valid_1's binary_logloss: 0.140731	valid_1's auc: 0.835775
[57]	valid_0's binary_logloss: 0.112423	valid_0's auc: 0.900882	valid_1's binary_logloss: 0.140747	valid_1's auc: 0.835795
[58]	valid_0's binary_logloss: 0.112179	valid_0's auc: 0.901235	valid_1's binary_logloss: 0.140809	valid_1's auc: 0.835782
Early stopping, best iteration is:
[28]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.886325	valid_1's binary_logloss: 0.139864	valid_1's auc: 0.837376
[1]	valid_0's binary_logloss: 0.156085	valid_0's auc: 0.820235	valid_1's binary_logloss: 0.164992	valid_1's auc: 0.81613
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150951	valid_0's auc: 0.825778	valid_1's binary_logloss: 0.159874	valid_1's auc: 0.821835
[3]	valid_0's binary_logloss: 0.147167	valid_0's auc: 0.832192	valid_1's binary_logloss: 0.156391	valid_1's auc: 0.827305
[4]	valid_0's binary_logloss: 0.144132	valid_0's auc: 0.837507	valid_1's binary_logloss: 0.15332	valid_1's auc: 0.8334
[5]	valid_0's binary_logloss: 0.141652	valid_0's auc: 0.842275	valid_1's binary_logloss: 0.150954	valid_1's auc: 0.836036
[6]	valid_0's binary_logloss: 0.139662	valid_0's auc: 0.844971	valid_1's binary_logloss: 0.149041	valid_1's auc: 0.838026
[7]	valid_0's binary_logloss: 0.138002	valid_0's auc: 0.846612	valid_1's binary_logloss: 0.147504	valid_1's auc: 0.837776
[8]	valid_0's binary_logloss: 0.136579	valid_0's auc: 0.848539	valid_1's binary_logloss: 0.14601	valid_1's auc: 0.839506
[9]	valid_0's binary_logloss: 0.135283	valid_0's auc: 0.850098	valid_1's binary_logloss: 0.144934	valid_1's auc: 0.84033
[10]	valid_0's binary_logloss: 0.134195	valid_0's auc: 0.852202	valid_1's binary_logloss: 0.144075	valid_1's auc: 0.840094
[11]	valid_0's binary_logloss: 0.133246	valid_0's auc: 0.853608	valid_1's binary_logloss: 0.143371	valid_1's auc: 0.839532
[12]	valid_0's binary_logloss: 0.132408	valid_0's auc: 0.854898	valid_1's binary_logloss: 0.142828	valid_1's auc: 0.838961
[13]	valid_0's binary_logloss: 0.131678	valid_0's auc: 0.855877	valid_1's binary_logloss: 0.142265	valid_1's auc: 0.839079
[14]	valid_0's binary_logloss: 0.130972	valid_0's auc: 0.857256	valid_1's binary_logloss: 0.14192	valid_1's auc: 0.838458
[15]	valid_0's binary_logloss: 0.130365	valid_0's auc: 0.85849	valid_1's binary_logloss: 0.141638	valid_1's auc: 0.837837
[16]	valid_0's binary_logloss: 0.129795	valid_0's auc: 0.859518	valid_1's binary_logloss: 0.141266	valid_1's auc: 0.837919
[17]	valid_0's binary_logloss: 0.129246	valid_0's auc: 0.86107	valid_1's binary_logloss: 0.141008	valid_1's auc: 0.837675
[18]	valid_0's binary_logloss: 0.128764	valid_0's auc: 0.862382	valid_1's binary_logloss: 0.140844	valid_1's auc: 0.83754
[19]	valid_0's binary_logloss: 0.128294	valid_0's auc: 0.86341	valid_1's binary_logloss: 0.140732	valid_1's auc: 0.836495
[20]	valid_0's binary_logloss: 0.127851	valid_0's auc: 0.864532	valid_1's binary_logloss: 0.140651	valid_1's auc: 0.835573
[21]	valid_0's binary_logloss: 0.127401	valid_0's auc: 0.865793	valid_1's binary_logloss: 0.140562	valid_1's auc: 0.835214
[22]	valid_0's binary_logloss: 0.127031	valid_0's auc: 0.866613	valid_1's binary_logloss: 0.14041	valid_1's auc: 0.834961
[23]	valid_0's binary_logloss: 0.126618	valid_0's auc: 0.867953	valid_1's binary_logloss: 0.140264	valid_1's auc: 0.835354
[24]	valid_0's binary_logloss: 0.126294	valid_0's auc: 0.868421	valid_1's binary_logloss: 0.140261	valid_1's auc: 0.834851
[25]	valid_0's binary_logloss: 0.12595	valid_0's auc: 0.869239	valid_1's binary_logloss: 0.140297	valid_1's auc: 0.834303
[26]	valid_0's binary_logloss: 0.125634	valid_0's auc: 0.869717	valid_1's binary_logloss: 0.140258	valid_1's auc: 0.833989
[27]	valid_0's binary_logloss: 0.125306	valid_0's auc: 0.871105	valid_1's binary_logloss: 0.140221	valid_1's auc: 0.834075
[28]	valid_0's binary_logloss: 0.125006	valid_0's auc: 0.871842	valid_1's binary_logloss: 0.140204	valid_1's auc: 0.833809
[29]	valid_0's binary_logloss: 0.124667	valid_0's auc: 0.872834	valid_1's binary_logloss: 0.140234	valid_1's auc: 0.833672
[30]	valid_0's binary_logloss: 0.124428	valid_0's auc: 0.873209	valid_1's binary_logloss: 0.140246	valid_1's auc: 0.833228
[31]	valid_0's binary_logloss: 0.124154	valid_0's auc: 0.873779	valid_1's binary_logloss: 0.140196	valid_1's auc: 0.833437
[32]	valid_0's binary_logloss: 0.123793	valid_0's auc: 0.875169	valid_1's binary_logloss: 0.140131	valid_1's auc: 0.833543
[33]	valid_0's binary_logloss: 0.123538	valid_0's auc: 0.875945	valid_1's binary_logloss: 0.140074	valid_1's auc: 0.833771
[34]	valid_0's binary_logloss: 0.123273	valid_0's auc: 0.876838	valid_1's binary_logloss: 0.140029	valid_1's auc: 0.834188
[35]	valid_0's binary_logloss: 0.123033	valid_0's auc: 0.877285	valid_1's binary_logloss: 0.140083	valid_1's auc: 0.833868
[36]	valid_0's binary_logloss: 0.122827	valid_0's auc: 0.877822	valid_1's binary_logloss: 0.140161	valid_1's auc: 0.833427
[37]	valid_0's binary_logloss: 0.122582	valid_0's auc: 0.87835	valid_1's binary_logloss: 0.140133	valid_1's auc: 0.833781
[38]	valid_0's binary_logloss: 0.122378	valid_0's auc: 0.878728	valid_1's binary_logloss: 0.140119	valid_1's auc: 0.833827
[39]	valid_0's binary_logloss: 0.122177	valid_0's auc: 0.879195	valid_1's binary_logloss: 0.140111	valid_1's auc: 0.833696
Early stopping, best iteration is:
[9]	valid_0's binary_logloss: 0.135283	valid_0's auc: 0.850098	valid_1's binary_logloss: 0.144934	valid_1's auc: 0.84033
[1]	valid_0's binary_logloss: 0.156452	valid_0's auc: 0.814371	valid_1's binary_logloss: 0.165418	valid_1's auc: 0.813175
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151081	valid_0's auc: 0.827202	valid_1's binary_logloss: 0.160086	valid_1's auc: 0.819989
[3]	valid_0's binary_logloss: 0.147219	valid_0's auc: 0.836893	valid_1's binary_logloss: 0.156403	valid_1's auc: 0.828833
[4]	valid_0's binary_logloss: 0.144211	valid_0's auc: 0.841451	valid_1's binary_logloss: 0.153547	valid_1's auc: 0.830881
[5]	valid_0#39;s binary_logloss: 0.141696	valid_0's auc: 0.843957	valid_1's binary_logloss: 0.151227	valid_1's auc: 0.832819
[6]	valid_0's binary_logloss: 0.139678	valid_0's auc: 0.847748	valid_1's binary_logloss: 0.149329	valid_1's auc: 0.836614
[7]	valid_0's binary_logloss: 0.137985	valid_0's auc: 0.849327	valid_1's binary_logloss: 0.147839	valid_1's auc: 0.836739
[8]	valid_0's binary_logloss: 0.136536	valid_0's auc: 0.850907	valid_1's binary_logloss: 0.146655	valid_1's auc: 0.836711
[9]	valid_0's binary_logloss: 0.135271	valid_0's auc: 0.85358	valid_1's binary_logloss: 0.145525	valid_1's auc: 0.838258
[10]	valid_0's binary_logloss: 0.134171	valid_0's auc: 0.854862	valid_1's binary_logloss: 0.144605	valid_1's auc: 0.837503
[11]	valid_0's binary_logloss: 0.133185	valid_0's auc: 0.856107	valid_1's binary_logloss: 0.143788	valid_1's auc: 0.837895
[12]	valid_0's binary_logloss: 0.132348	valid_0's auc: 0.857143	valid_1's binary_logloss: 0.143194	valid_1's auc: 0.837519
[13]	valid_0's binary_logloss: 0.131563	valid_0's auc: 0.858514	valid_1's binary_logloss: 0.142655	valid_1's auc: 0.837281
[14]	valid_0's binary_logloss: 0.130866	valid_0's auc: 0.859381	valid_1's binary_logloss: 0.142234	valid_1's auc: 0.836814
[15]	valid_0's binary_logloss: 0.130265	valid_0's auc: 0.860107	valid_1's binary_logloss: 0.141784	valid_1's auc: 0.837227
[16]	valid_0's binary_logloss: 0.129652	valid_0's auc: 0.861293	valid_1's binary_logloss: 0.141436	valid_1's auc: 0.837155
[17]	valid_0's binary_logloss: 0.129	valid_0's auc: 0.862801	valid_1's binary_logloss: 0.141233	valid_1's auc: 0.836554
[18]	valid_0's binary_logloss: 0.128456	valid_0's auc: 0.864095	valid_1's binary_logloss: 0.140968	valid_1's auc: 0.836466
[19]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.864873	valid_1's binary_logloss: 0.140684	valid_1's auc: 0.837462
[20]	valid_0's binary_logloss: 0.127475	valid_0's auc: 0.866514	valid_1's binary_logloss: 0.140492	valid_1's auc: 0.837791
[21]	valid_0's binary_logloss: 0.127019	valid_0's auc: 0.867526	valid_1's binary_logloss: 0.140352	valid_1's auc: 0.837515
[22]	valid_0's binary_logloss: 0.126586	valid_0's auc: 0.868522	valid_1's binary_logloss: 0.14027	valid_1's auc: 0.837105
[23]	valid_0's binary_logloss: 0.126176	valid_0's auc: 0.869624	valid_1's binary_logloss: 0.140097	valid_1's auc: 0.837722
[24]	valid_0's binary_logloss: 0.125766	valid_0's auc: 0.870398	valid_1's binary_logloss: 0.140002	valid_1's auc: 0.838042
[25]	valid_0's binary_logloss: 0.125436	valid_0's auc: 0.871071	valid_1's binary_logloss: 0.139982	valid_1's auc: 0.837726
[26]	valid_0's binary_logloss: 0.125096	valid_0's auc: 0.871873	valid_1's binary_logloss: 0.139903	valid_1's auc: 0.837516
[27]	valid_0's binary_logloss: 0.124766	valid_0's auc: 0.872747	valid_1's binary_logloss: 0.139873	valid_1's auc: 0.83744
[28]	valid_0's binary_logloss: 0.124448	valid_0's auc: 0.873243	valid_1's binary_logloss: 0.139828	valid_1's auc: 0.837467
[29]	valid_0's binary_logloss: 0.124164	valid_0's auc: 0.873959	valid_1's binary_logloss: 0.139781	valid_1's auc: 0.83751
[30]	valid_0's binary_logloss: 0.123934	valid_0's auc: 0.874666	valid_1's binary_logloss: 0.139667	valid_1's auc: 0.837891
[31]	valid_0's binary_logloss: 0.123703	valid_0's auc: 0.875615	valid_1's binary_logloss: 0.139545	valid_1's auc: 0.83861
[32]	valid_0's binary_logloss: 0.123475	valid_0's auc: 0.876151	valid_1's binary_logloss: 0.13945	valid_1's auc: 0.838762
[33]	valid_0's binary_logloss: 0.123248	valid_0's auc: 0.877026	valid_1's binary_logloss: 0.139439	valid_1's auc: 0.838799
[34]	valid_0's binary_logloss: 0.123057	valid_0's auc: 0.877606	valid_1's binary_logloss: 0.139447	valid_1's auc: 0.838511
[35]	valid_0's binary_logloss: 0.122861	valid_0's auc: 0.878266	valid_1's binary_logloss: 0.139413	valid_1's auc: 0.838604
[36]	valid_0's binary_logloss: 0.122635	valid_0's auc: 0.87885	valid_1's binary_logloss: 0.139347	valid_1's auc: 0.838919
[37]	valid_0's binary_logloss: 0.12236	valid_0's auc: 0.879609	valid_1's binary_logloss: 0.139342	valid_1's auc: 0.83891
[38]	valid_0's binary_logloss: 0.12211	valid_0's auc: 0.879941	valid_1's binary_logloss: 0.139438	valid_1's auc: 0.838586
[39]	valid_0's binary_logloss: 0.121864	valid_0's auc: 0.880723	valid_1's binary_logloss: 0.139421	valid_1's auc: 0.838655
[40]	valid_0's binary_logloss: 0.121708	valid_0's auc: 0.881052	valid_1's binary_logloss: 0.139358	valid_1's auc: 0.83903
[41]	valid_0's binary_logloss: 0.12146	valid_0's auc: 0.881719	valid_1's binary_logloss: 0.139353	valid_1's auc: 0.83903
[42]	valid_0's binary_logloss: 0.121168	valid_0's auc: 0.882841	valid_1's binary_logloss: 0.139266	valid_1's auc: 0.83955
[43]	valid_0's binary_logloss: 0.120936	valid_0's auc: 0.883416	valid_1's binary_logloss: 0.139368	valid_1's auc: 0.839046
[44]	valid_0's binary_logloss: 0.120707	valid_0's auc: 0.883946	valid_1's binary_logloss: 0.139372	valid_1's auc: 0.839079
[45]	valid_0's binary_logloss: 0.120517	valid_0's auc: 0.884413	valid_1's binary_logloss: 0.139355	valid_1's auc: 0.839058
[46]	valid_0's binary_logloss: 0.120366	valid_0's auc: 0.884779	valid_1's binary_logloss: 0.139393	valid_1's auc: 0.839074
[47]	valid_0's binary_logloss: 0.120167	valid_0's auc: 0.885151	valid_1's binary_logloss: 0.139448	valid_1's auc: 0.838763
[48]	valid_0's binary_logloss: 0.120017	valid_0's auc: 0.885423	valid_1's binary_logloss: 0.13953	valid_1's auc: 0.838439
[49]	valid_0's binary_logloss: 0.119829	valid_0's auc: 0.885803	valid_1's binary_logloss: 0.139561	valid_1's auc: 0.83829
[50]	valid_0's binary_logloss: 0.119647	valid_0's auc: 0.886174	valid_1's binary_logloss: 0.139549	valid_1's auc: 0.838535
[51]	valid_0's binary_logloss: 0.119508	valid_0's auc: 0.886427	valid_1's binary_logloss: 0.139591	valid_1's auc: 0.838257
[52]	valid_0's binary_logloss: 0.119359	valid_0's auc: 0.886951	valid_1's binary_logloss: 0.139563	valid_1's auc: 0.838568
[53]	valid_0's binary_logloss: 0.119176	valid_0's auc: 0.887355	valid_1's binary_logloss: 0.139628	valid_1's auc: 0.838543
[54]	valid_0's binary_logloss: 0.118981	valid_0's auc: 0.887921	valid_1's binary_logloss: 0.139624	valid_1's auc: 0.838756
[55]	valid_0's binary_logloss: 0.118841	valid_0's auc: 0.888212	valid_1's binary_logloss: 0.139629	valid_1's auc: 0.838784
[56]	valid_0's binary_logloss: 0.118658	valid_0's auc: 0.888594	valid_1's binary_logloss: 0.139663	valid_1's auc: 0.838629
[57]	valid_0's binary_logloss: 0.118515	valid_0's auc: 0.888819	valid_1's binary_logloss: 0.139621	valid_1's auc: 0.838717
[58]	valid_0's binary_logloss: 0.118357	valid_0's auc: 0.889162	valid_1's binary_logloss: 0.139688	valid_1's auc: 0.838462
[59]	valid_0's binary_logloss: 0.118197	valid_0's auc: 0.889806	valid_1's binary_logloss: 0.139725	valid_1's auc: 0.838289
[60]	valid_0's binary_logloss: 0.118088	valid_0's auc: 0.889976	valid_1's binary_logloss: 0.139761	valid_1's auc: 0.83829
[61]	valid_0's binary_logloss: 0.117943	valid_0's auc: 0.890299	valid_1's binary_logloss: 0.139821	valid_1's auc: 0.838077
[62]	valid_0's binary_logloss: 0.117814	valid_0's auc: 0.890524	valid_1's binary_logloss: 0.139809	valid_1's auc: 0.838161
[63]	valid_0's binary_logloss: 0.117695	valid_0's auc: 0.890741	valid_1's binary_logloss: 0.139891	valid_1's auc: 0.837883
[64]	valid_0's binary_logloss: 0.117563	valid_0's auc: 0.891078	valid_1's binary_logloss: 0.139952	valid_1's auc: 0.837654
[65]	valid_0's binary_logloss: 0.117396	valid_0's auc: 0.891298	valid_1's binary_logloss: 0.139936	valid_1's auc: 0.837908
[66]	valid_0's binary_logloss: 0.117294	valid_0's auc: 0.891444	valid_1's binary_logloss: 0.139968	valid_1's auc: 0.837798
[67]	valid_0's binary_logloss: 0.117199	valid_0's auc: 0.891558	valid_1's binary_logloss: 0.139951	valid_1's auc: 0.837884
[68]	valid_0's binary_logloss: 0.117047	valid_0's auc: 0.891842	valid_1's binary_logloss: 0.139964	valid_1's auc: 0.837726
[69]	valid_0's binary_logloss: 0.116905	valid_0's auc: 0.892333	valid_1's binary_logloss: 0.140006	valid_1's auc: 0.837619
[70]	valid_0's binary_logloss: 0.116695	valid_0's auc: 0.892833	valid_1's binary_logloss: 0.139965	valid_1's auc: 0.837858
[71]	valid_0's binary_logloss: 0.116607	valid_0's auc: 0.892846	valid_1's binary_logloss: 0.140063	valid_1's auc: 0.837642
[72]	valid_0's binary_logloss: 0.116525	valid_0's auc: 0.892948	valid_1's binary_logloss: 0.140129	valid_1's auc: 0.837423
Early stopping, best iteration is:
[42]	valid_0's binary_logloss: 0.121168	valid_0's auc: 0.882841	valid_1's binary_logloss: 0.139266	valid_1's auc: 0.83955
[1]	valid_0's binary_logloss: 0.156528	valid_0's auc: 0.821645	valid_1's binary_logloss: 0.165101	valid_1's auc: 0.81857
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151187	valid_0's auc: 0.827652	valid_1's binary_logloss: 0.160088	valid_1's auc: 0.82254
[3]	valid_0's binary_logloss: 0.147263	valid_0's auc: 0.836059	valid_1's binary_logloss: 0.156608	valid_1's auc: 0.828121
[4]	valid_0's binary_logloss: 0.144258	valid_0's auc: 0.840507	valid_1's binary_logloss: 0.153573	valid_1's auc: 0.831883
[5]	valid_0's binary_logloss: 0.141763	valid_0's auc: 0.841889	valid_1's binary_logloss: 0.151258	valid_1's auc: 0.834129
[6]	valid_0's binary_logloss: 0.139749	valid_0's auc: 0.84495	valid_1's binary_logloss: 0.149359	valid_1's auc: 0.835139
[7]	valid_0's binary_logloss: 0.138082	valid_0's auc: 0.845803	valid_1's binary_logloss: 0.147853	valid_1's auc: 0.834809
[8]	valid_0's binary_logloss: 0.136693	valid_0's auc: 0.847136	valid_1's binary_logloss: 0.146585	valid_1's auc: 0.836717
[9]	valid_0's binary_logloss: 0.135437	valid_0's auc: 0.849549	valid_1's binary_logloss: 0.145575	valid_1's auc: 0.837358
[10]	valid_0's binary_logloss: 0.134374	valid_0's auc: 0.850797	valid_1's binary_logloss: 0.144671	valid_1's auc: 0.83794
[11]	valid_0's binary_logloss: 0.133441	valid_0's auc: 0.85216	valid_1's binary_logloss: 0.143939	valid_1's auc: 0.83805
[12]	valid_0's binary_logloss: 0.132621	valid_0's auc: 0.854509	valid_1's binary_logloss: 0.143406	valid_1's auc: 0.838172
[13]	valid_0's binary_logloss: 0.131801	valid_0's auc: 0.856837	valid_1's binary_logloss: 0.142845	valid_1's auc: 0.838172
[14]	valid_0's binary_logloss: 0.131085	valid_0's auc: 0.858379	valid_1's binary_logloss: 0.142438	valid_1's auc: 0.838161
[15]	valid_0's binary_logloss: 0.130403	valid_0's auc: 0.859828	valid_1's binary_logloss: 0.142128	valid_1's auc: 0.837333
[16]	valid_0's binary_logloss: 0.129848	valid_0's auc: 0.861034	valid_1's binary_logloss: 0.141806	valid_1's auc: 0.836715
[17]	valid_0's binary_logloss: 0.129299	valid_0's auc: 0.861775	valid_1's binary_logloss: 0.141398	valid_1's auc: 0.837193
[18]	valid_0's binary_logloss: 0.128797	valid_0's auc: 0.862844	valid_1's binary_logloss: 0.141105	valid_1's auc: 0.837688
[19]	valid_0's binary_logloss: 0.128254	valid_0's auc: 0.864183	valid_1's binary_logloss: 0.1408	valid_1's auc: 0.838493
[20]	valid_0's binary_logloss: 0.127764	valid_0's auc: 0.865434	valid_1's binary_logloss: 0.140629	valid_1's auc: 0.83826
[21]	valid_0's binary_logloss: 0.127313	valid_0's auc: 0.866549	valid_1's binary_logloss: 0.140491	valid_1's auc: 0.83802
[22]	valid_0's binary_logloss: 0.126892	valid_0's auc: 0.867557	valid_1's binary_logloss: 0.140253	valid_1's auc: 0.838476
[23]	valid_0's binary_logloss: 0.126489	valid_0's auc: 0.868549	valid_1's binary_logloss: 0.14015	valid_1's auc: 0.838499
[24]	valid_0's binary_logloss: 0.126193	valid_0's auc: 0.869053	valid_1's binary_logloss: 0.139968	valid_1's auc: 0.83904
[25]	valid_0's binary_logloss: 0.12589	valid_0's auc: 0.869728	valid_1's binary_logloss: 0.139803	valid_1's auc: 0.839059
[26]	valid_0's binary_logloss: 0.125571	valid_0's auc: 0.870373	valid_1's binary_logloss: 0.139698	valid_1's auc: 0.839138
[27]	valid_0's binary_logloss: 0.125257	valid_0's auc: 0.871341	valid_1's binary_logloss: 0.139664	valid_1's auc: 0.838837
[28]	valid_0's binary_logloss: 0.124955	valid_0's auc: 0.872255	valid_1's binary_logloss: 0.139614	valid_1's auc: 0.838733
[29]	valid_0's binary_logloss: 0.124683	valid_0's auc: 0.872979	valid_1's binary_logloss: 0.139634	valid_1's auc: 0.838445
[30]	valid_0's binary_logloss: 0.12443	valid_0's auc: 0.873557	valid_1's binary_logloss: 0.139581	valid_1's auc: 0.838392
[31]	valid_0's binary_logloss: 0.124188	valid_0's auc: 0.874202	valid_1's binary_logloss: 0.139633	valid_1's auc: 0.837993
[32]	valid_0's binary_logloss: 0.123929	valid_0's auc: 0.874831	valid_1's binary_logloss: 0.139651	valid_1's auc: 0.837759
[33]	valid_0's binary_logloss: 0.123718	valid_0's auc: 0.87536	valid_1's binary_logloss: 0.139601	valid_1's auc: 0.838121
[34]	valid_0's binary_logloss: 0.123446	valid_0's auc: 0.876098	valid_1's binary_logloss: 0.13959	valid_1's auc: 0.838127
[35]	valid_0's binary_logloss: 0.123227	valid_0's auc: 0.876685	valid_1's binary_logloss: 0.139632	valid_1's auc: 0.837767
[36]	valid_0's binary_logloss: 0.122984	valid_0's auc: 0.877273	valid_1's binary_logloss: 0.139635	valid_1's auc: 0.837941
[37]	valid_0's binary_logloss: 0.12276	valid_0's auc: 0.877868	valid_1's binary_logloss: 0.139578	valid_1's auc: 0.83805
[38]	valid_0's binary_logloss: 0.122494	valid_0's auc: 0.878325	valid_1's binary_logloss: 0.139527	valid_1's auc: 0.83832
[39]	valid_0's binary_logloss: 0.122248	valid_0's auc: 0.878917	valid_1's binary_logloss: 0.139516	valid_1's auc: 0.838503
[40]	valid_0's binary_logloss: 0.122038	valid_0's auc: 0.879406	valid_1's binary_logloss: 0.139475	valid_1's auc: 0.838825
[41]	valid_0's binary_logloss: 0.121865	valid_0's auc: 0.87982	valid_1's binary_logloss: 0.139525	valid_1's auc: 0.838607
[42]	valid_0's binary_logloss: 0.121697	valid_0's auc: 0.880217	valid_1's binary_logloss: 0.139582	valid_1's auc: 0.838459
[43]	valid_0's binary_logloss: 0.121448	valid_0's auc: 0.881131	valid_1's binary_logloss: 0.139571	valid_1's auc: 0.838519
[44]	valid_0's binary_logloss: 0.121268	valid_0's auc: 0.881502	valid_1's binary_logloss: 0.13955	valid_1's auc: 0.838652
[45]	valid_0's binary_logloss: 0.121081	valid_0's auc: 0.881982	valid_1's binary_logloss: 0.139559	valid_1's auc: 0.83858
[46]	valid_0's binary_logloss: 0.120906	valid_0's auc: 0.88233	valid_1's binary_logloss: 0.139657	valid_1's auc: 0.838247
[47]	valid_0's binary_logloss: 0.120707	valid_0's auc: 0.882781	valid_1's binary_logloss: 0.139655	valid_1's auc: 0.838252
[48]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.882987	valid_1's binary_logloss: 0.13965	valid_1's auc: 0.838213
[49]	valid_0's binary_logloss: 0.120348	valid_0's auc: 0.883422	valid_1's binary_logloss: 0.139707	valid_1's auc: 0.838107
[50]	valid_0's binary_logloss: 0.120181	valid_0's auc: 0.883798	valid_1's binary_logloss: 0.139747	valid_1's auc: 0.838134
[51]	valid_0's binary_logloss: 0.11997	valid_0's auc: 0.884299	valid_1's binary_logloss: 0.139789	valid_1's auc: 0.837738
[52]	valid_0's binary_logloss: 0.119771	valid_0's auc: 0.884801	valid_1's binary_logloss: 0.139841	valid_1's auc: 0.837647
[53]	valid_0's binary_logloss: 0.119577	valid_0's auc: 0.885413	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.837395
[54]	valid_0's binary_logloss: 0.119342	valid_0's auc: 0.885952	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.837545
[55]	valid_0's binary_logloss: 0.119167	valid_0's auc: 0.886405	valid_1's binary_logloss: 0.139935	valid_1's auc: 0.837432
[56]	valid_0's binary_logloss: 0.119038	valid_0's auc: 0.886617	valid_1's binary_logloss: 0.14002	valid_1's auc: 0.83708
Early stopping, best iteration is:
[26]	valid_0's binary_logloss: 0.125571	valid_0's auc: 0.870373	valid_1's binary_logloss: 0.139698	valid_1's auc: 0.839138
[1]	valid_0's binary_logloss: 0.156085	valid_0's auc: 0.820235	valid_1's binary_logloss: 0.164992	valid_1's auc: 0.81613
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150951	valid_0's auc: 0.825778	valid_1's binary_logloss: 0.159874	valid_1's auc: 0.821835
[3]	valid_0's binary_logloss: 0.147167	valid_0's auc: 0.832192	valid_1's binary_logloss: 0.156391	valid_1's auc: 0.827305
[4]	valid_0's binary_logloss: 0.144132	valid_0's auc: 0.837507	valid_1's binary_logloss: 0.15332	valid_1's auc: 0.8334
[5]	valid_0's binary_logloss: 0.141652	valid_0's auc: 0.842275	valid_1's binary_logloss: 0.150954	valid_1's auc: 0.836036
[6]	valid_0's binary_logloss: 0.139662	valid_0's auc: 0.844971	valid_1's binary_logloss: 0.149041	valid_1's auc: 0.838026
[7]	valid_0's binary_logloss: 0.138002	valid_0's auc: 0.846612	valid_1's binary_logloss: 0.147504	valid_1's auc: 0.837776
[8]	valid_0's binary_logloss: 0.136579	valid_0's auc: 0.848539	valid_1's binary_logloss: 0.14601	valid_1's auc: 0.839506
[9]	valid_0's binary_logloss: 0.135283	valid_0's auc: 0.850098	valid_1's binary_logloss: 0.144934	valid_1's auc: 0.84033
[10]	valid_0's binary_logloss: 0.134195	valid_0's auc: 0.852202	valid_1's binary_logloss: 0.144075	valid_1's auc: 0.840094
[11]	valid_0's binary_logloss: 0.133246	valid_0's auc: 0.853608	valid_1's binary_logloss: 0.143371	valid_1's auc: 0.839532
[12]	valid_0's binary_logloss: 0.132408	valid_0's auc: 0.854898	valid_1's binary_logloss: 0.142828	valid_1's auc: 0.838961
[13]	valid_0's binary_logloss: 0.131678	valid_0's auc: 0.855877	valid_1's binary_logloss: 0.142265	valid_1's auc: 0.839079
[14]	valid_0's binary_logloss: 0.130972	valid_0's auc: 0.857256	valid_1's binary_logloss: 0.14192	valid_1's auc: 0.838458
[15]	valid_0's binary_logloss: 0.130365	valid_0's auc: 0.85849	valid_1's binary_logloss: 0.141638	valid_1's auc: 0.837837
[16]	valid_0's binary_logloss: 0.129795	valid_0's auc: 0.859518	valid_1's binary_logloss: 0.141266	valid_1's auc: 0.837919
[17]	valid_0's binary_logloss: 0.129246	valid_0's auc: 0.86107	valid_1's binary_logloss: 0.141008	valid_1's auc: 0.837675
[18]	valid_0's binary_logloss: 0.128764	valid_0's auc: 0.862382	valid_1's binary_logloss: 0.140844	valid_1's auc: 0.83754
[19]	valid_0's binary_logloss: 0.128294	valid_0's auc: 0.86341	valid_1's binary_logloss: 0.140732	valid_1's auc: 0.836495
[20]	valid_0's binary_logloss: 0.127851	valid_0's auc: 0.864532	valid_1's binary_logloss: 0.140651	valid_1's auc: 0.835573
[21]	valid_0's binary_logloss: 0.127401	valid_0's auc: 0.865793	valid_1's binary_logloss: 0.140562	valid_1's auc: 0.835214
[22]	valid_0's binary_logloss: 0.127031	valid_0's auc: 0.866613	valid_1's binary_logloss: 0.14041	valid_1's auc: 0.834961
[23]	valid_0's binary_logloss: 0.126618	valid_0's auc: 0.867953	valid_1's binary_logloss: 0.140264	valid_1's auc: 0.835354
[24]	valid_0's binary_logloss: 0.126294	valid_0's auc: 0.868421	valid_1's binary_logloss: 0.140261	valid_1's auc: 0.834851
[25]	valid_0's binary_logloss: 0.12595	valid_0's auc: 0.869239	valid_1's binary_logloss: 0.140297	valid_1's auc: 0.834303
[26]	valid_0's binary_logloss: 0.125634	valid_0's auc: 0.869717	valid_1's binary_logloss: 0.140258	valid_1's auc: 0.833989
[27]	valid_0's binary_logloss: 0.125306	valid_0's auc: 0.871105	valid_1's binary_logloss: 0.140221	valid_1's auc: 0.834075
[28]	valid_0's binary_logloss: 0.125006	valid_0's auc: 0.871842	valid_1's binary_logloss: 0.140204	valid_1's auc: 0.833809
[29]	valid_0's binary_logloss: 0.124667	valid_0's auc: 0.872834	valid_1's binary_logloss: 0.140234	valid_1's auc: 0.833672
[30]	valid_0's binary_logloss: 0.124428	valid_0's auc: 0.873209	valid_1's binary_logloss: 0.140246	valid_1's auc: 0.833228
[31]	valid_0's binary_logloss: 0.124154	valid_0's auc: 0.873779	valid_1's binary_logloss: 0.140196	valid_1's auc: 0.833437
[32]	valid_0's binary_logloss: 0.123793	valid_0's auc: 0.875169	valid_1's binary_logloss: 0.140131	valid_1's auc: 0.833543
[33]	valid_0's binary_logloss: 0.123538	valid_0's auc: 0.875945	valid_1's binary_logloss: 0.140074	valid_1's auc: 0.833771
[34]	valid_0's binary_logloss: 0.123273	valid_0's auc: 0.876838	valid_1's binary_logloss: 0.140029	valid_1's auc: 0.834188
[35]	valid_0's binary_logloss: 0.123033	valid_0's auc: 0.877285	valid_1's binary_logloss: 0.140083	valid_1's auc: 0.833868
[36]	valid_0's binary_logloss: 0.122827	valid_0's auc: 0.877822	valid_1's binary_logloss: 0.140161	valid_1's auc: 0.833427
[37]	valid_0's binary_logloss: 0.122582	valid_0's auc: 0.87835	valid_1's binary_logloss: 0.140133	valid_1's auc: 0.833781
[38]	valid_0's binary_logloss: 0.122378	valid_0's auc: 0.878728	valid_1's binary_logloss: 0.140119	valid_1's auc: 0.833827
[39]	valid_0's binary_logloss: 0.122177	valid_0's auc: 0.879195	valid_1's binary_logloss: 0.140111	valid_1's auc: 0.833696
Early stopping, best iteration is:
[9]	valid_0's binary_logloss: 0.135283	valid_0's auc: 0.850098	valid_1's binary_logloss: 0.144934	valid_1's auc: 0.84033
[1]	valid_0's binary_logloss: 0.156452	valid_0's auc: 0.814371	valid_1's binary_logloss: 0.165418	valid_1's auc: 0.813175
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151081	valid_0's auc: 0.827202	valid_1's binary_logloss: 0.160086	valid_1's auc: 0.819989
[3]	valid_0's binary_logloss: 0.147219	valid_0's auc: 0.836893	valid_1's binary_logloss: 0.156403	valid_1's auc: 0.828833
[4]	valid_0's binary_logloss: 0.144211	valid_0's auc: 0.841451	valid_1's binary_logloss: 0.153547	valid_1's auc: 0.830881
[5]	valid_0's binary_logloss: 0.141696	valid_0's auc: 0.843957	valid_1's binary_logloss: 0.151227	valid_1's auc: 0.832819
[6]	valid_0's binary_logloss: 0.139678	valid_0's auc: 0.847748	valid_1's binary_logloss: 0.149329	valid_1's auc: 0.836614
[7]	valid_0's binary_logloss: 0.137985	valid_0's auc: 0.849327	valid_1's binary_logloss: 0.147839	valid_1's auc: 0.836739
[8]	valid_0's binary_logloss: 0.136536	valid_0's auc: 0.850907	valid_1's binary_logloss: 0.146655	valid_1's auc: 0.836711
[9]	valid_0's binary_logloss: 0.135271	valid_0's auc: 0.85358	valid_1's binary_logloss: 0.145525	valid_1's auc: 0.838258
[10]	valid_0's binary_logloss: 0.134171	valid_0's auc: 0.854862	valid_1's binary_logloss: 0.144605	valid_1's auc: 0.837503
[11]	valid_0's binary_logloss: 0.133185	valid_0's auc: 0.856107	valid_1's binary_logloss: 0.143788	valid_1's auc: 0.837895
[12]	valid_0's binary_logloss: 0.132348	valid_0's auc: 0.857143	valid_1's binary_logloss: 0.143194	valid_1's auc: 0.837519
[13]	valid_0's binary_logloss: 0.131563	valid_0's auc: 0.858514	valid_1's binary_logloss: 0.142655	valid_1's auc: 0.837281
[14]	valid_0's binary_logloss: 0.130866	valid_0's auc: 0.859381	valid_1's binary_logloss: 0.142234	valid_1's auc: 0.836814
[15]	valid_0's binary_logloss: 0.130265	valid_0's auc: 0.860107	valid_1's binary_logloss: 0.141784	valid_1's auc: 0.837227
[16]	valid_0's binary_logloss: 0.129652	valid_0's auc: 0.861293	valid_1's binary_logloss: 0.141436	valid_1's auc: 0.837155
[17]	valid_0's binary_logloss: 0.129	valid_0's auc: 0.862801	valid_1's binary_logloss: 0.141233	valid_1's auc: 0.836554
[18]	valid_0's binary_logloss: 0.128456	valid_0's auc: 0.864095	valid_1's binary_logloss: 0.140968	valid_1's auc: 0.836466
[19]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.864873	valid_1's binary_logloss: 0.140684	valid_1's auc: 0.837462
[20]	valid_0's binary_logloss: 0.127475	valid_0's auc: 0.866514	valid_1's binary_logloss: 0.140492	valid_1's auc: 0.837791
[21]	valid_0's binary_logloss: 0.127019	valid_0's auc: 0.867526	valid_1's binary_logloss: 0.140352	valid_1's auc: 0.837515
[22]	valid_0's binary_logloss: 0.126586	valid_0's auc: 0.868522	valid_1's binary_logloss: 0.14027	valid_1's auc: 0.837105
[23]	valid_0's binary_logloss: 0.126176	valid_0's auc: 0.869624	valid_1's binary_logloss: 0.140097	valid_1's auc: 0.837722
[24]	valid_0's binary_logloss: 0.125766	valid_0's auc: 0.870398	valid_1's binary_logloss: 0.140002	valid_1's auc: 0.838042
[25]	valid_0's binary_logloss: 0.125436	valid_0's auc: 0.871071	valid_1's binary_logloss: 0.139982	valid_1's auc: 0.837726
[26]	valid_0's binary_logloss: 0.125096	valid_0's auc: 0.871873	valid_1's binary_logloss: 0.139903	valid_1's auc: 0.837516
[27]	valid_0's binary_logloss: 0.124766	valid_0's auc: 0.872747	valid_1's binary_logloss: 0.139873	valid_1's auc: 0.83744
[28]	valid_0's binary_logloss: 0.124448	valid_0's auc: 0.873243	valid_1's binary_logloss: 0.139828	valid_1's auc: 0.837467
[29]	valid_0's binary_logloss: 0.124164	valid_0's auc: 0.873959	valid_1's binary_logloss: 0.139781	valid_1's auc: 0.83751
[30]	valid_0's binary_logloss: 0.123934	valid_0's auc: 0.874666	valid_1's binary_logloss: 0.139667	valid_1's auc: 0.837891
[31]	valid_0's binary_logloss: 0.123703	valid_0's auc: 0.875615	valid_1's binary_logloss: 0.139545	valid_1's auc: 0.83861
[32]	valid_0's binary_logloss: 0.123475	valid_0's auc: 0.876151	valid_1's binary_logloss: 0.13945	valid_1's auc: 0.838762
[33]	valid_0's binary_logloss: 0.123248	valid_0's auc: 0.877026	valid_1's binary_logloss: 0.139439	valid_1's auc: 0.838799
[34]	valid_0's binary_logloss: 0.123057	valid_0's auc: 0.877606	valid_1's binary_logloss: 0.139447	valid_1's auc: 0.838511
[35]	valid_0's binary_logloss: 0.122861	valid_0's auc: 0.878266	valid_1's binary_logloss: 0.139413	valid_1's auc: 0.838604
[36]	valid_0's binary_logloss: 0.122635	valid_0's auc: 0.87885	valid_1's binary_logloss: 0.139347	valid_1's auc: 0.838919
[37]	valid_0's binary_logloss: 0.12236	valid_0's auc: 0.879609	valid_1's binary_logloss: 0.139342	valid_1's auc: 0.83891
[38]	valid_0's binary_logloss: 0.12211	valid_0's auc: 0.879941	valid_1's binary_logloss: 0.139438	valid_1's auc: 0.838586
[39]	valid_0's binary_logloss: 0.121864	valid_0's auc: 0.880723	valid_1's binary_logloss: 0.139421	valid_1's auc: 0.838655
[40]	valid_0's binary_logloss: 0.121708	valid_0's auc: 0.881052	valid_1's binary_logloss: 0.139358	valid_1's auc: 0.83903
[41]	valid_0's binary_logloss: 0.12146	valid_0's auc: 0.881719	valid_1's binary_logloss: 0.139353	valid_1's auc: 0.83903
[42]	valid_0's binary_logloss: 0.121168	valid_0's auc: 0.882841	valid_1's binary_logloss: 0.139266	valid_1's auc: 0.83955
[43]	valid_0's binary_logloss: 0.120936	valid_0's auc: 0.883416	valid_1's binary_logloss: 0.139368	valid_1's auc: 0.839046
[44]	valid_0's binary_logloss: 0.120707	valid_0's auc: 0.883946	valid_1's binary_logloss: 0.139372	valid_1's auc: 0.839079
[45]	valid_0's binary_logloss: 0.120517	valid_0's auc: 0.884413	valid_1's binary_logloss: 0.139355	valid_1's auc: 0.839058
[46]	valid_0's binary_logloss: 0.120366	valid_0's auc: 0.884779	valid_1's binary_logloss: 0.139393	valid_1's auc: 0.839074
[47]	valid_0's binary_logloss: 0.120167	valid_0's auc: 0.885151	valid_1's binary_logloss: 0.139448	valid_1's auc: 0.838763
[48]	valid_0's binary_logloss: 0.120017	valid_0's auc: 0.885423	valid_1's binary_logloss: 0.13953	valid_1's auc: 0.838439
[49]	valid_0's binary_logloss: 0.119829	valid_0's auc: 0.885803	valid_1's binary_logloss: 0.139561	valid_1's auc: 0.83829
[50]	valid_0's binary_logloss: 0.119647	valid_0's auc: 0.886174	valid_1's binary_logloss: 0.139549	valid_1's auc: 0.838535
[51]	valid_0's binary_logloss: 0.119508	valid_0's auc: 0.886427	valid_1's binary_logloss: 0.139591	valid_1's auc: 0.838257
[52]	valid_0's binary_logloss: 0.119359	valid_0's auc: 0.886951	valid_1's binary_logloss: 0.139563	valid_1's auc: 0.838568
[53]	valid_0's binary_logloss: 0.119176	valid_0's auc: 0.887355	valid_1's binary_logloss: 0.139628	valid_1's auc: 0.838543
[54]	valid_0's binary_logloss: 0.118981	valid_0's auc: 0.887921	valid_1's binary_logloss: 0.139624	valid_1's auc: 0.838756
[55]	valid_0's binary_logloss: 0.118841	valid_0's auc: 0.888212	valid_1's binary_logloss: 0.139629	valid_1's auc: 0.838784
[56]	valid_0's binary_logloss: 0.118658	valid_0's auc: 0.888594	valid_1's binary_logloss: 0.139663	valid_1's auc: 0.838629
[57]	valid_0's binary_logloss: 0.118515	valid_0's auc: 0.888819	valid_1's binary_logloss: 0.139621	valid_1's auc: 0.838717
[58]	valid_0's binary_logloss: 0.118357	valid_0's auc: 0.889162	valid_1's binary_logloss: 0.139688	valid_1's auc: 0.838462
[59]	valid_0's binary_logloss: 0.118197	valid_0's auc: 0.889806	valid_1's binary_logloss: 0.139725	valid_1's auc: 0.838289
[60]	valid_0's binary_logloss: 0.118088	valid_0's auc: 0.889976	valid_1's binary_logloss: 0.139761	valid_1's auc: 0.83829
[61]	valid_0's binary_logloss: 0.117943	valid_0's auc: 0.890299	valid_1's binary_logloss: 0.139821	valid_1's auc: 0.838077
[62]	valid_0's binary_logloss: 0.117814	valid_0's auc: 0.890524	valid_1's binary_logloss: 0.139809	valid_1's auc: 0.838161
[63]	valid_0's binary_logloss: 0.117695	valid_0's auc: 0.890741	valid_1's binary_logloss: 0.139891	valid_1's auc: 0.837883
[64]	valid_0's binary_logloss: 0.117563	valid_0's auc: 0.891078	valid_1's binary_logloss: 0.139952	valid_1's auc: 0.837654
[65]	valid_0's binary_logloss: 0.117396	valid_0's auc: 0.891298	valid_1's binary_logloss: 0.139936	valid_1's auc: 0.837908
[66]	valid_0's binary_logloss: 0.117294	valid_0's auc: 0.891444	valid_1's binary_logloss: 0.139968	valid_1's auc: 0.837798
[67]	valid_0's binary_logloss: 0.117199	valid_0's auc: 0.891558	valid_1's binary_logloss: 0.139951	valid_1's auc: 0.837884
[68]	valid_0's binary_logloss: 0.117047	valid_0's auc: 0.891842	valid_1's binary_logloss: 0.139964	valid_1's auc: 0.837726
[69]	valid_0's binary_logloss: 0.116905	valid_0's auc: 0.892333	valid_1's binary_logloss: 0.140006	valid_1's auc: 0.837619
[70]	valid_0's binary_logloss: 0.116695	valid_0's auc: 0.892833	valid_1's binary_logloss: 0.139965	valid_1's auc: 0.837858
[71]	valid_0's binary_logloss: 0.116607	valid_0's auc: 0.892846	valid_1's binary_logloss: 0.140063	valid_1's auc: 0.837642
[72]	valid_0's binary_logloss: 0.116525	valid_0's auc: 0.892948	valid_1's binary_logloss: 0.140129	valid_1's auc: 0.837423
Early stopping, best iteration is:
[42]	valid_0's binary_logloss: 0.121168	valid_0's auc: 0.882841	valid_1's binary_logloss: 0.139266	valid_1's auc: 0.83955
[1]	valid_0's binary_logloss: 0.156528	valid_0's auc: 0.821645	valid_1's binary_logloss: 0.165101	valid_1's auc: 0.81857
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151187	valid_0's auc: 0.827652	valid_1's binary_logloss: 0.160088	valid_1's auc: 0.82254
[3]	valid_0's binary_logloss: 0.147263	valid_0's auc: 0.836059	valid_1's binary_logloss: 0.156608	valid_1's auc: 0.828121
[4]	valid_0's binary_logloss: 0.144258	valid_0's auc: 0.840507	valid_1's binary_logloss: 0.153573	valid_1's auc: 0.831883
[5]	valid_0's binary_logloss: 0.141763	valid_0's auc: 0.841889	valid_1's binary_logloss: 0.151258	valid_1's auc: 0.834129
[6]	valid_0's binary_logloss: 0.139749	valid_0's auc: 0.84495	valid_1's binary_logloss: 0.149359	valid_1's auc: 0.835139
[7]	valid_0's binary_logloss: 0.138082	valid_0's auc: 0.845803	valid_1's binary_logloss: 0.147853	valid_1's auc: 0.834809
[8]	valid_0's binary_logloss: 0.136693	valid_0's auc: 0.847136	valid_1's binary_logloss: 0.146585	valid_1's auc: 0.836717
[9]	valid_0's binary_logloss: 0.135437	valid_0's auc: 0.849549	valid_1's binary_logloss: 0.145575	valid_1's auc: 0.837358
[10]	valid_0's binary_logloss: 0.134374	valid_0's auc: 0.850797	valid_1's binary_logloss: 0.144671	valid_1's auc: 0.83794
[11]	valid_0's binary_logloss: 0.133441	valid_0's auc: 0.85216	valid_1's binary_logloss: 0.143939	valid_1's auc: 0.83805
[12]	valid_0's binary_logloss: 0.132621	valid_0's auc: 0.854509	valid_1's binary_logloss: 0.143406	valid_1's auc: 0.838172
[13]	valid_0's binary_logloss: 0.131801	valid_0's auc: 0.856837	valid_1's binary_logloss: 0.142845	valid_1's auc: 0.838172
[14]	valid_0's binary_logloss: 0.131085	valid_0's auc: 0.858379	valid_1's binary_logloss: 0.142438	valid_1's auc: 0.838161
[15]	valid_0's binary_logloss: 0.130403	valid_0's auc: 0.859828	valid_1's binary_logloss: 0.142128	valid_1's auc: 0.837333
[16]	valid_0's binary_logloss: 0.129848	valid_0's auc: 0.861034	valid_1's binary_logloss: 0.141806	valid_1's auc: 0.836715
[17]	valid_0's binary_logloss: 0.129299	valid_0's auc: 0.861775	valid_1's binary_logloss: 0.141398	valid_1's auc: 0.837193
[18]	valid_0's binary_logloss: 0.128797	valid_0's auc: 0.862844	valid_1's binary_logloss: 0.141105	valid_1's auc: 0.837688
[19]	valid_0's binary_logloss: 0.128254	valid_0's auc: 0.864183	valid_1's binary_logloss: 0.1408	valid_1's auc: 0.838493
[20]	valid_0's binary_logloss: 0.127764	valid_0's auc: 0.865434	valid_1's binary_logloss: 0.140629	valid_1's auc: 0.83826
[21]	valid_0's binary_logloss: 0.127313	valid_0's auc: 0.866549	valid_1's binary_logloss: 0.140491	valid_1's auc: 0.83802
[22]	valid_0's binary_logloss: 0.126892	valid_0's auc: 0.867557	valid_1's binary_logloss: 0.140253	valid_1's auc: 0.838476
[23]	valid_0's binary_logloss: 0.126489	valid_0's auc: 0.868549	valid_1's binary_logloss: 0.14015	valid_1's auc: 0.838499
[24]	valid_0's binary_logloss: 0.126193	valid_0's auc: 0.869053	valid_1's binary_logloss: 0.139968	valid_1's auc: 0.83904
[25]	valid_0's binary_logloss: 0.12589	valid_0's auc: 0.869728	valid_1's binary_logloss: 0.139803	valid_1's auc: 0.839059
[26]	valid_0's binary_logloss: 0.125571	valid_0's auc: 0.870373	valid_1's binary_logloss: 0.139698	valid_1's auc: 0.839138
[27]	valid_0's binary_logloss: 0.125257	valid_0's auc: 0.871341	valid_1's binary_logloss: 0.139664	valid_1's auc: 0.838837
[28]	valid_0's binary_logloss: 0.124955	valid_0's auc: 0.872255	valid_1's binary_logloss: 0.139614	valid_1's auc: 0.838733
[29]	valid_0's binary_logloss: 0.124683	valid_0's auc: 0.872979	valid_1's binary_logloss: 0.139634	valid_1's auc: 0.838445
[30]	valid_0's binary_logloss: 0.12443	valid_0's auc: 0.873557	valid_1's binary_logloss: 0.139581	valid_1's auc: 0.838392
[31]	valid_0's binary_logloss: 0.124188	valid_0's auc: 0.874202	valid_1's binary_logloss: 0.139633	valid_1's auc: 0.837993
[32]	valid_0's binary_logloss: 0.123929	valid_0's auc: 0.874831	valid_1's binary_logloss: 0.139651	valid_1's auc: 0.837759
[33]	valid_0's binary_logloss: 0.123718	valid_0's auc: 0.87536	valid_1's binary_logloss: 0.139601	valid_1's auc: 0.838121
[34]	valid_0's binary_logloss: 0.123446	valid_0's auc: 0.876098	valid_1's binary_logloss: 0.13959	valid_1's auc: 0.838127
[35]	valid_0's binary_logloss: 0.123227	valid_0's auc: 0.876685	valid_1's binary_logloss: 0.139632	valid_1's auc: 0.837767
[36]	valid_0's binary_logloss: 0.122984	valid_0's auc: 0.877273	valid_1's binary_logloss: 0.139635	valid_1's auc: 0.837941
[37]	valid_0's binary_logloss: 0.12276	valid_0's auc: 0.877868	valid_1's binary_logloss: 0.139578	valid_1's auc: 0.83805
[38]	valid_0's binary_logloss: 0.122494	valid_0's auc: 0.878325	valid_1's binary_logloss: 0.139527	valid_1's auc: 0.83832
[39]	valid_0's binary_logloss: 0.122248	valid_0's auc: 0.878917	valid_1's binary_logloss: 0.139516	valid_1's auc: 0.838503
[40]	valid_0's binary_logloss: 0.122038	valid_0's auc: 0.879406	valid_1's binary_logloss: 0.139475	valid_1's auc: 0.838825
[41]	valid_0's binary_logloss: 0.121865	valid_0's auc: 0.87982	valid_1's binary_logloss: 0.139525	valid_1's auc: 0.838607
[42]	valid_0's binary_logloss: 0.121697	valid_0's auc: 0.880217	valid_1's binary_logloss: 0.139582	valid_1's auc: 0.838459
[43]	valid_0's binary_logloss: 0.121448	valid_0's auc: 0.881131	valid_1's binary_logloss: 0.139571	valid_1's auc: 0.838519
[44]	valid_0's binary_logloss: 0.121268	valid_0's auc: 0.881502	valid_1's binary_logloss: 0.13955	valid_1's auc: 0.838652
[45]	valid_0's binary_logloss: 0.121081	valid_0's auc: 0.881982	valid_1's binary_logloss: 0.139559	valid_1's auc: 0.83858
[46]	valid_0's binary_logloss: 0.120906	valid_0's auc: 0.88233	valid_1's binary_logloss: 0.139657	valid_1's auc: 0.838247
[47]	valid_0's binary_logloss: 0.120707	valid_0's auc: 0.882781	valid_1's binary_logloss: 0.139655	valid_1's auc: 0.838252
[48]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.882987	valid_1's binary_logloss: 0.13965	valid_1's auc: 0.838213
[49]	valid_0's binary_logloss: 0.120348	valid_0's auc: 0.883422	valid_1's binary_logloss: 0.139707	valid_1's auc: 0.838107
[50]	valid_0's binary_logloss: 0.120181	valid_0's auc: 0.883798	valid_1's binary_logloss: 0.139747	valid_1's auc: 0.838134
[51]	valid_0's binary_logloss: 0.11997	valid_0's auc: 0.884299	valid_1's binary_logloss: 0.139789	valid_1's auc: 0.837738
[52]	valid_0's binary_logloss: 0.119771	valid_0's auc: 0.884801	valid_1's binary_logloss: 0.139841	valid_1's auc: 0.837647
[53]	valid_0's binary_logloss: 0.119577	valid_0's auc: 0.885413	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.837395
[54]	valid_0's binary_logloss: 0.119342	valid_0's auc: 0.885952	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.837545
[55]	valid_0's binary_logloss: 0.119167	valid_0's auc: 0.886405	valid_1's binary_logloss: 0.139935	valid_1's auc: 0.837432
[56]	valid_0's binary_logloss: 0.119038	valid_0's auc: 0.886617	valid_1's binary_logloss: 0.14002	valid_1's auc: 0.83708
Early stopping, best iteration is:
[26]	valid_0's binary_logloss: 0.125571	valid_0's auc: 0.870373	valid_1's binary_logloss: 0.139698	valid_1's auc: 0.839138
[1]	valid_0's binary_logloss: 0.155302	valid_0's auc: 0.832891	valid_1's binary_logloss: 0.164826	valid_1's auc: 0.818851
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.149839	valid_0's auc: 0.842061	valid_1's binary_logloss: 0.159948	valid_1's auc: 0.825811
[3]	valid_0's binary_logloss: 0.14568	valid_0's auc: 0.849289	valid_1's binary_logloss: 0.156323	valid_1's auc: 0.828876
[4]	valid_0's binary_logloss: 0.142471	valid_0's auc: 0.85217	valid_1's binary_logloss: 0.153508	valid_1's auc: 0.830597
[5]	valid_0's binary_logloss: 0.139777	valid_0's auc: 0.854239	valid_1's binary_logloss: 0.15132	valid_1's auc: 0.831714
[6]	valid_0's binary_logloss: 0.137571	valid_0's auc: 0.857317	valid_1's binary_logloss: 0.149408	valid_1's auc: 0.834748
[7]	valid_0's binary_logloss: 0.13571	valid_0's auc: 0.860006	valid_1's binary_logloss: 0.14797	valid_1's auc: 0.834676
[8]	valid_0's binary_logloss: 0.134125	valid_0's auc: 0.862097	valid_1's binary_logloss: 0.146851	valid_1's auc: 0.833523
[9]	valid_0's binary_logloss: 0.132674	valid_0's auc: 0.863502	valid_1's binary_logloss: 0.145855	valid_1's auc: 0.83389
[10]	valid_0's binary_logloss: 0.131436	valid_0's auc: 0.865388	valid_1's binary_logloss: 0.145006	valid_1's auc: 0.83527
[11]	valid_0's binary_logloss: 0.130246	valid_0's auc: 0.867991	valid_1's binary_logloss: 0.14443	valid_1's auc: 0.834165
[12]	valid_0's binary_logloss: 0.129245	valid_0's auc: 0.868905	valid_1's binary_logloss: 0.143794	valid_1's auc: 0.834913
[13]	valid_0's binary_logloss: 0.128279	valid_0's auc: 0.871383	valid_1's binary_logloss: 0.143188	valid_1's auc: 0.835098
[14]	valid_0's binary_logloss: 0.127403	valid_0's auc: 0.872929	valid_1's binary_logloss: 0.142967	valid_1's auc: 0.833943
[15]	valid_0's binary_logloss: 0.126607	valid_0's auc: 0.87404	valid_1's binary_logloss: 0.142812	valid_1's auc: 0.833167
[16]	valid_0's binary_logloss: 0.12587	valid_0's auc: 0.875242	valid_1's binary_logloss: 0.142587	valid_1's auc: 0.832607
[17]	valid_0's binary_logloss: 0.125177	valid_0's auc: 0.876378	valid_1's binary_logloss: 0.142458	valid_1's auc: 0.83187
[18]	valid_0's binary_logloss: 0.124483	valid_0's auc: 0.877407	valid_1's binary_logloss: 0.142321	valid_1's auc: 0.83163
[19]	valid_0's binary_logloss: 0.123852	valid_0's auc: 0.878701	valid_1's binary_logloss: 0.142189	valid_1's auc: 0.831198
[20]	valid_0's binary_logloss: 0.123249	valid_0's auc: 0.880271	valid_1's binary_logloss: 0.142161	valid_1's auc: 0.830575
[21]	valid_0's binary_logloss: 0.122681	valid_0's auc: 0.881003	valid_1's binary_logloss: 0.142018	valid_1's auc: 0.830093
[22]	valid_0's binary_logloss: 0.122144	valid_0's auc: 0.882219	valid_1's binary_logloss: 0.141898	valid_1's auc: 0.829706
[23]	valid_0's binary_logloss: 0.121633	valid_0's auc: 0.883017	valid_1's binary_logloss: 0.14183	valid_1's auc: 0.829552
[24]	valid_0's binary_logloss: 0.121216	valid_0's auc: 0.883934	valid_1's binary_logloss: 0.14176	valid_1's auc: 0.829498
[25]	valid_0's binary_logloss: 0.120698	valid_0's auc: 0.885463	valid_1's binary_logloss: 0.141833	valid_1's auc: 0.828588
[26]	valid_0's binary_logloss: 0.120291	valid_0's auc: 0.886554	valid_1's binary_logloss: 0.141817	valid_1's auc: 0.8285
[27]	valid_0's binary_logloss: 0.119825	valid_0's auc: 0.887374	valid_1's binary_logloss: 0.141826	valid_1's auc: 0.828014
[28]	valid_0's binary_logloss: 0.11942	valid_0's auc: 0.888077	valid_1's binary_logloss: 0.14177	valid_1's auc: 0.827886
[29]	valid_0's binary_logloss: 0.119041	valid_0's auc: 0.888773	valid_1's binary_logloss: 0.141763	valid_1's auc: 0.827921
[30]	valid_0's binary_logloss: 0.118672	valid_0's auc: 0.889591	valid_1's binary_logloss: 0.141616	valid_1's auc: 0.828616
[31]	valid_0's binary_logloss: 0.118339	valid_0's auc: 0.889981	valid_1's binary_logloss: 0.141555	valid_1's auc: 0.828525
[32]	valid_0's binary_logloss: 0.117949	valid_0's auc: 0.891237	valid_1's binary_logloss: 0.141603	valid_1's auc: 0.828309
[33]	valid_0's binary_logloss: 0.117655	valid_0's auc: 0.891831	valid_1's binary_logloss: 0.141685	valid_1's auc: 0.827914
[34]	valid_0's binary_logloss: 0.117339	valid_0's auc: 0.892391	valid_1's binary_logloss: 0.141814	valid_1's auc: 0.827348
[35]	valid_0's binary_logloss: 0.116984	valid_0's auc: 0.893036	valid_1's binary_logloss: 0.141867	valid_1's auc: 0.827162
[36]	valid_0's binary_logloss: 0.116643	valid_0's auc: 0.893952	valid_1's binary_logloss: 0.141919	valid_1's auc: 0.82722
[37]	valid_0's binary_logloss: 0.116343	valid_0's auc: 0.894628	valid_1's binary_logloss: 0.141964	valid_1's auc: 0.827088
[38]	valid_0's binary_logloss: 0.11609	valid_0's auc: 0.895063	valid_1's binary_logloss: 0.141947	valid_1's auc: 0.827376
[39]	valid_0's binary_logloss: 0.115776	valid_0's auc: 0.895511	valid_1's binary_logloss: 0.142035	valid_1's auc: 0.826977
[40]	valid_0's binary_logloss: 0.115526	valid_0's auc: 0.895873	valid_1's binary_logloss: 0.142022	valid_1's auc: 0.827266
Early stopping, best iteration is:
[10]	valid_0's binary_logloss: 0.131436	valid_0's auc: 0.865388	valid_1's binary_logloss: 0.145006	valid_1's auc: 0.83527
[1]	valid_0's binary_logloss: 0.15572	valid_0's auc: 0.833054	valid_1's binary_logloss: 0.165036	valid_1's auc: 0.817048
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.14989	valid_0's auc: 0.841411	valid_1's binary_logloss: 0.159541	valid_1's auc: 0.821568
[3]	valid_0's binary_logloss: 0.14572	valid_0's auc: 0.849517	valid_1's binary_logloss: 0.155987	valid_1's auc: 0.82788
[4]	valid_0's binary_logloss: 0.142455	valid_0's auc: 0.853918	valid_1's binary_logloss: 0.153089	valid_1's auc: 0.830738
[5]	valid_0's binary_logloss: 0.139735	valid_0's auc: 0.857301	valid_1's binary_logloss: 0.150632	valid_1's auc: 0.834385
[6]	valid_0's binary_logloss: 0.137505	valid_0's auc: 0.860317	valid_1's binary_logloss: 0.148792	valid_1's auc: 0.834978
[7]	valid_0's binary_logloss: 0.135605	valid_0's auc: 0.862342	valid_1's binary_logloss: 0.147286	valid_1's auc: 0.836808
[8]	valid_0's binary_logloss: 0.133938	valid_0's auc: 0.863801	valid_1's binary_logloss: 0.146148	valid_1's auc: 0.836233
[9]	valid_0's binary_logloss: 0.132456	valid_0's auc: 0.865686	valid_1's binary_logloss: 0.145138	valid_1's auc: 0.836224
[10]	valid_0's binary_logloss: 0.131167	valid_0's auc: 0.867095	valid_1's binary_logloss: 0.144312	valid_1's auc: 0.83568
[11]	valid_0's binary_logloss: 0.130032	valid_0's auc: 0.868321	valid_1's binary_logloss: 0.143512	valid_1's auc: 0.836598
[12]	valid_0's binary_logloss: 0.128915	valid_0's auc: 0.870342	valid_1's binary_logloss: 0.142896	valid_1's auc: 0.836786
[13]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.871602	valid_1's binary_logloss: 0.142313	valid_1's auc: 0.837475
[14]	valid_0's binary_logloss: 0.127074	valid_0's auc: 0.873492	valid_1's binary_logloss: 0.141918	valid_1's auc: 0.837308
[15]	valid_0's binary_logloss: 0.126249	valid_0's auc: 0.874714	valid_1's binary_logloss: 0.141545	valid_1's auc: 0.837265
[16]	valid_0's binary_logloss: 0.125412	valid_0's auc: 0.876498	valid_1's binary_logloss: 0.141306	valid_1's auc: 0.837064
[17]	valid_0's binary_logloss: 0.124674	valid_0's auc: 0.877697	valid_1's binary_logloss: 0.141243	valid_1's auc: 0.835667
[18]	valid_0's binary_logloss: 0.124004	valid_0's auc: 0.878754	valid_1's binary_logloss: 0.141001	valid_1's auc: 0.836266
[19]	valid_0's binary_logloss: 0.123324	valid_0's auc: 0.880151	valid_1's binary_logloss: 0.14069	valid_1's auc: 0.836858
[20]	valid_0's binary_logloss: 0.122647	valid_0's auc: 0.88214	valid_1's binary_logloss: 0.140681	valid_1's auc: 0.83574
[21]	valid_0's binary_logloss: 0.12205	valid_0's auc: 0.883119	valid_1's binary_logloss: 0.140627	valid_1's auc: 0.83555
[22]	valid_0's binary_logloss: 0.121526	valid_0's auc: 0.884243	valid_1's binary_logloss: 0.140488	valid_1's auc: 0.83609
[23]	valid_0's binary_logloss: 0.120992	valid_0's auc: 0.885369	valid_1's binary_logloss: 0.140443	valid_1's auc: 0.835781
[24]	valid_0's binary_logloss: 0.120502	valid_0's auc: 0.886215	valid_1's binary_logloss: 0.140363	valid_1's auc: 0.835501
[25]	valid_0's binary_logloss: 0.119975	valid_0's auc: 0.887513	valid_1's binary_logloss: 0.140274	valid_1's auc: 0.835926
[26]	valid_0's binary_logloss: 0.119497	valid_0's auc: 0.888713	valid_1's binary_logloss: 0.140329	valid_1's auc: 0.835254
[27]	valid_0's binary_logloss: 0.11904	valid_0's auc: 0.889795	valid_1's binary_logloss: 0.140341	valid_1's auc: 0.835371
[28]	valid_0's binary_logloss: 0.118653	valid_0's auc: 0.8904	valid_1's binary_logloss: 0.140409	valid_1's auc: 0.834904
[29]	valid_0's binary_logloss: 0.118177	valid_0's auc: 0.891515	valid_1's binary_logloss: 0.14043	valid_1's auc: 0.834421
[30]	valid_0's binary_logloss: 0.117737	valid_0's auc: 0.892538	valid_1's binary_logloss: 0.14048	valid_1's auc: 0.834461
[31]	valid_0's binary_logloss: 0.11742	valid_0's auc: 0.893059	valid_1's binary_logloss: 0.140513	valid_1's auc: 0.834053
[32]	valid_0's binary_logloss: 0.117057	valid_0's auc: 0.893934	valid_1's binary_logloss: 0.140434	valid_1's auc: 0.83418
[33]	valid_0's binary_logloss: 0.116716	valid_0's auc: 0.894932	valid_1's binary_logloss: 0.140491	valid_1's auc: 0.833793
[34]	valid_0's binary_logloss: 0.116371	valid_0's auc: 0.895434	valid_1's binary_logloss: 0.140476	valid_1's auc: 0.834146
[35]	valid_0's binary_logloss: 0.11604	valid_0's auc: 0.896238	valid_1's binary_logloss: 0.140613	valid_1's auc: 0.833608
[36]	valid_0's binary_logloss: 0.115738	valid_0's auc: 0.896761	valid_1's binary_logloss: 0.140566	valid_1's auc: 0.833866
[37]	valid_0's binary_logloss: 0.115445	valid_0's auc: 0.897255	valid_1's binary_logloss: 0.140618	valid_1's auc: 0.833835
[38]	valid_0's binary_logloss: 0.115107	valid_0's auc: 0.897979	valid_1's binary_logloss: 0.14069	valid_1's auc: 0.833409
[39]	valid_0's binary_logloss: 0.114705	valid_0's auc: 0.898947	valid_1's binary_logloss: 0.140754	valid_1's auc: 0.833262
[40]	valid_0's binary_logloss: 0.114409	valid_0's auc: 0.899579	valid_1's binary_logloss: 0.140759	valid_1's auc: 0.833304
[41]	valid_0's binary_logloss: 0.114104	valid_0's auc: 0.900418	valid_1's binary_logloss: 0.140854	valid_1's auc: 0.833244
[42]	valid_0's binary_logloss: 0.113727	valid_0's auc: 0.901143	valid_1's binary_logloss: 0.14096	valid_1's auc: 0.83271
[43]	valid_0's binary_logloss: 0.113493	valid_0's auc: 0.901603	valid_1's binary_logloss: 0.141012	valid_1's auc: 0.832882
Early stopping, best iteration is:
[13]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.871602	valid_1's binary_logloss: 0.142313	valid_1's auc: 0.837475
[1]	valid_0's binary_logloss: 0.155759	valid_0's auc: 0.830643	valid_1's binary_logloss: 0.164985	valid_1's auc: 0.816734
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.149985	valid_0's auc: 0.839231	valid_1's binary_logloss: 0.159847	valid_1's auc: 0.822161
[3]	valid_0's binary_logloss: 0.14584	valid_0's auc: 0.847482	valid_1's binary_logloss: 0.156209	valid_1's auc: 0.828931
[4]	valid_0's binary_logloss: 0.142477	valid_0's auc: 0.85096	valid_1's binary_logloss: 0.153261	valid_1's auc: 0.83076
[5]	valid_0's binary_logloss: 0.139743	valid_0's auc: 0.854424	valid_1's binary_logloss: 0.150964	valid_1's auc: 0.832373
[6]	valid_0's binary_logloss: 0.137578	valid_0's auc: 0.856208	valid_1's binary_logloss: 0.149014	valid_1's auc: 0.835151
[7]	valid_0's binary_logloss: 0.135714	valid_0's auc: 0.857684	valid_1's binary_logloss: 0.147459	valid_1's auc: 0.836459
[8]	valid_0's binary_logloss: 0.134043	valid_0's auc: 0.859848	valid_1's binary_logloss: 0.146266	valid_1's auc: 0.835502
[9]	valid_0's binary_logloss: 0.132596	valid_0's auc: 0.862422	valid_1's binary_logloss: 0.145301	valid_1's auc: 0.835298
[10]	valid_0's binary_logloss: 0.131312	valid_0's auc: 0.86448	valid_1's binary_logloss: 0.144368	valid_1's auc: 0.836102
[11]	valid_0's binary_logloss: 0.130164	valid_0's auc: 0.86587	valid_1's binary_logloss: 0.14376	valid_1's auc: 0.836347
[12]	valid_0's binary_logloss: 0.129168	valid_0's auc: 0.867975	valid_1's binary_logloss: 0.143155	valid_1's auc: 0.836728
[13]	valid_0's binary_logloss: 0.128157	valid_0's auc: 0.870558	valid_1's binary_logloss: 0.142684	valid_1's auc: 0.836515
[14]	valid_0's binary_logloss: 0.127255	valid_0's auc: 0.872242	valid_1's binary_logloss: 0.142312	valid_1's auc: 0.836322
[15]	valid_0's binary_logloss: 0.126426	valid_0's auc: 0.873758	valid_1's binary_logloss: 0.14194	valid_1's auc: 0.836377
[16]	valid_0's binary_logloss: 0.125659	valid_0's auc: 0.875262	valid_1's binary_logloss: 0.141765	valid_1's auc: 0.835719
[17]	valid_0's binary_logloss: 0.124929	valid_0's auc: 0.876886	valid_1's binary_logloss: 0.141548	valid_1's auc: 0.835566
[18]	valid_0's binary_logloss: 0.124244	valid_0's auc: 0.878549	valid_1's binary_logloss: 0.141281	valid_1's auc: 0.835682
[19]	valid_0's binary_logloss: 0.12357	valid_0's auc: 0.880422	valid_1's binary_logloss: 0.141181	valid_1's auc: 0.835543
[20]	valid_0's binary_logloss: 0.123016	valid_0's auc: 0.881339	valid_1's binary_logloss: 0.140981	valid_1's auc: 0.835789
[21]	valid_0's binary_logloss: 0.12242	valid_0's auc: 0.882595	valid_1's binary_logloss: 0.140807	valid_1's auc: 0.83617
[22]	valid_0's binary_logloss: 0.121854	valid_0's auc: 0.883944	valid_1's binary_logloss: 0.140685	valid_1's auc: 0.835977
[23]	valid_0's binary_logloss: 0.121312	valid_0's auc: 0.884786	valid_1's binary_logloss: 0.140658	valid_1's auc: 0.835988
[24]	valid_0's binary_logloss: 0.120748	valid_0's auc: 0.88598	valid_1's binary_logloss: 0.140629	valid_1's auc: 0.83552
[25]	valid_0's binary_logloss: 0.120274	valid_0's auc: 0.887201	valid_1's binary_logloss: 0.14052	valid_1's auc: 0.835925
[26]	valid_0's binary_logloss: 0.119775	valid_0's auc: 0.888423	valid_1's binary_logloss: 0.140493	valid_1's auc: 0.835694
[27]	valid_0's binary_logloss: 0.119337	valid_0's auc: 0.889313	valid_1's binary_logloss: 0.140489	valid_1's auc: 0.835559
[28]	valid_0's binary_logloss: 0.118884	valid_0's auc: 0.890034	valid_1's binary_logloss: 0.14046	valid_1's auc: 0.835284
[29]	valid_0's binary_logloss: 0.11848	valid_0's auc: 0.890803	valid_1's binary_logloss: 0.14033	valid_1's auc: 0.835875
[30]	valid_0's binary_logloss: 0.118067	valid_0's auc: 0.891689	valid_1's binary_logloss: 0.140375	valid_1's auc: 0.835628
[31]	valid_0's binary_logloss: 0.117678	valid_0's auc: 0.892688	valid_1's binary_logloss: 0.140399	valid_1's auc: 0.835223
[32]	valid_0's binary_logloss: 0.117315	valid_0's auc: 0.893404	valid_1's binary_logloss: 0.140444	valid_1's auc: 0.834945
[33]	valid_0's binary_logloss: 0.116905	valid_0's auc: 0.894165	valid_1's binary_logloss: 0.140407	valid_1's auc: 0.834973
[34]	valid_0's binary_logloss: 0.116504	valid_0's auc: 0.895202	valid_1's binary_logloss: 0.140299	valid_1's auc: 0.835507
[35]	valid_0's binary_logloss: 0.116137	valid_0's auc: 0.896193	valid_1's binary_logloss: 0.140215	valid_1's auc: 0.835906
[36]	valid_0's binary_logloss: 0.115852	valid_0's auc: 0.896674	valid_1's binary_logloss: 0.140177	valid_1's auc: 0.836061
[37]	valid_0's binary_logloss: 0.115534	valid_0's auc: 0.897433	valid_1's binary_logloss: 0.140099	valid_1's auc: 0.836293
[38]	valid_0's binary_logloss: 0.115209	valid_0's auc: 0.897849	valid_1's binary_logloss: 0.140252	valid_1's auc: 0.835887
[39]	valid_0's binary_logloss: 0.114876	valid_0's auc: 0.898318	valid_1's binary_logloss: 0.140398	valid_1's auc: 0.835559
[40]	valid_0's binary_logloss: 0.114599	valid_0's auc: 0.898626	valid_1's binary_logloss: 0.140471	valid_1's auc: 0.835318
[41]	valid_0's binary_logloss: 0.114312	valid_0's auc: 0.899041	valid_1's binary_logloss: 0.140386	valid_1's auc: 0.835822
[42]	valid_0's binary_logloss: 0.114071	valid_0's auc: 0.899694	valid_1's binary_logloss: 0.140332	valid_1's auc: 0.836277
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.129168	valid_0's auc: 0.867975	valid_1's binary_logloss: 0.143155	valid_1's auc: 0.836728
[1]	valid_0's binary_logloss: 0.155302	valid_0's auc: 0.832891	valid_1's binary_logloss: 0.164826	valid_1's auc: 0.818851
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.149839	valid_0's auc: 0.842061	valid_1's binary_logloss: 0.159948	valid_1's auc: 0.825811
[3]	valid_0's binary_logloss: 0.14568	valid_0's auc: 0.849289	valid_1's binary_logloss: 0.156323	valid_1's auc: 0.828876
[4]	valid_0's binary_logloss: 0.142471	valid_0's auc: 0.85217	valid_1's binary_logloss: 0.153508	valid_1's auc: 0.830597
[5]	valid_0's binary_logloss: 0.139777	valid_0's auc: 0.854239	valid_1's binary_logloss: 0.15132	valid_1's auc: 0.831714
[6]	valid_0's binary_logloss: 0.137571	valid_0's auc: 0.857317	valid_1's binary_logloss: 0.149408	valid_1's auc: 0.834748
[7]	valid_0's binary_logloss: 0.13571	valid_0's auc: 0.860006	valid_1's binary_logloss: 0.14797	valid_1's auc: 0.834676
[8]	valid_0's binary_logloss: 0.134125	valid_0's auc: 0.862097	valid_1's binary_logloss: 0.146851	valid_1's auc: 0.833523
[9]	valid_0's binary_logloss: 0.132674	valid_0's auc: 0.863502	valid_1's binary_logloss: 0.145855	valid_1's auc: 0.83389
[10]	valid_0's binary_logloss: 0.131436	valid_0's auc: 0.865388	valid_1's binary_logloss: 0.145006	valid_1's auc: 0.83527
[11]	valid_0's binary_logloss: 0.130246	valid_0's auc: 0.867991	valid_1's binary_logloss: 0.14443	valid_1's auc: 0.834165
[12]	valid_0's binary_logloss: 0.129245	valid_0's auc: 0.868905	valid_1's binary_logloss: 0.143794	valid_1's auc: 0.834913
[13]	valid_0's binary_logloss: 0.128279	valid_0's auc: 0.871383	valid_1's binary_logloss: 0.143188	valid_1's auc: 0.835098
[14]	valid_0's binary_logloss: 0.127403	valid_0's auc: 0.872929	valid_1's binary_logloss: 0.142967	valid_1's auc: 0.833943
[15]	valid_0's binary_logloss: 0.126607	valid_0's auc: 0.87404	valid_1's binary_logloss: 0.142812	valid_1's auc: 0.833167
[16]	valid_0's binary_logloss: 0.12587	valid_0's auc: 0.875242	valid_1's binary_logloss: 0.142587	valid_1's auc: 0.832607
[17]	valid_0's binary_logloss: 0.125177	valid_0's auc: 0.876378	valid_1's binary_logloss: 0.142458	valid_1's auc: 0.83187
[18]	valid_0's binary_logloss: 0.124483	valid_0's auc: 0.877407	valid_1's binary_logloss: 0.142321	valid_1's auc: 0.83163
[19]	valid_0's binary_logloss: 0.123852	valid_0's auc: 0.878701	valid_1's binary_logloss: 0.142189	valid_1's auc: 0.831198
[20]	valid_0's binary_logloss: 0.123249	valid_0's auc: 0.880271	valid_1's binary_logloss: 0.142161	valid_1's auc: 0.830575
[21]	valid_0's binary_logloss: 0.122681	valid_0's auc: 0.881003	valid_1's binary_logloss: 0.142018	valid_1's auc: 0.830093
[22]	valid_0's binary_logloss: 0.122144	valid_0's auc: 0.882219	valid_1's binary_logloss: 0.141898	valid_1's auc: 0.829706
[23]	valid_0's binary_logloss: 0.121633	valid_0's auc: 0.883017	valid_1's binary_logloss: 0.14183	valid_1's auc: 0.829552
[24]	valid_0's binary_logloss: 0.121216	valid_0's auc: 0.883934	valid_1's binary_logloss: 0.14176	valid_1's auc: 0.829498
[25]	valid_0's binary_logloss: 0.120698	valid_0's auc: 0.885463	valid_1's binary_logloss: 0.141833	valid_1's auc: 0.828588
[26]	valid_0's binary_logloss: 0.120291	valid_0's auc: 0.886554	valid_1's binary_logloss: 0.141817	valid_1's auc: 0.8285
[27]	valid_0's binary_logloss: 0.119825	valid_0's auc: 0.887374	valid_1's binary_logloss: 0.141826	valid_1's auc: 0.828014
[28]	valid_0's binary_logloss: 0.11942	valid_0's auc: 0.888077	valid_1's binary_logloss: 0.14177	valid_1's auc: 0.827886
[29]	valid_0's binary_logloss: 0.119041	valid_0's auc: 0.888773	valid_1's binary_logloss: 0.141763	valid_1's auc: 0.827921
[30]	valid_0's binary_logloss: 0.118672	valid_0's auc: 0.889591	valid_1's binary_logloss: 0.141616	valid_1's auc: 0.828616
[31]	valid_0's binary_logloss: 0.118339	valid_0's auc: 0.889981	valid_1's binary_logloss: 0.141555	valid_1's auc: 0.828525
[32]	valid_0's binary_logloss: 0.117949	valid_0's auc: 0.891237	valid_1's binary_logloss: 0.141603	valid_1's auc: 0.828309
[33]	valid_0's binary_logloss: 0.117655	valid_0's auc: 0.891831	valid_1's binary_logloss: 0.141685	valid_1's auc: 0.827914
[34]	valid_0's binary_logloss: 0.117339	valid_0's auc: 0.892391	valid_1's binary_logloss: 0.141814	valid_1's auc: 0.827348
[35]	valid_0's binary_logloss: 0.116984	valid_0's auc: 0.893036	valid_1's binary_logloss: 0.141867	valid_1's auc: 0.827162
[36]	valid_0's binary_logloss: 0.116643	valid_0's auc: 0.893952	valid_1's binary_logloss: 0.141919	valid_1's auc: 0.82722
[37]	valid_0's binary_logloss: 0.116343	valid_0's auc: 0.894628	valid_1's binary_logloss: 0.141964	valid_1's auc: 0.827088
[38]	valid_0's binary_logloss: 0.11609	valid_0's auc: 0.895063	valid_1's binary_logloss: 0.141947	valid_1's auc: 0.827376
[39]	valid_0's binary_logloss: 0.115776	valid_0's auc: 0.895511	valid_1's binary_logloss: 0.142035	valid_1's auc: 0.826977
[40]	valid_0's binary_logloss: 0.115526	valid_0's auc: 0.895873	valid_1's binary_logloss: 0.142022	valid_1's auc: 0.827266
Early stopping, best iteration is:
[10]	valid_0's binary_logloss: 0.131436	valid_0's auc: 0.865388	valid_1's binary_logloss: 0.145006	valid_1's auc: 0.83527
[1]	valid_0's binary_logloss: 0.15572	valid_0's auc: 0.833054	valid_1's binary_logloss: 0.165036	valid_1's auc: 0.817048
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.14989	valid_0's auc: 0.841411	valid_1's binary_logloss: 0.159541	valid_1's auc: 0.821568
[3]	valid_0's binary_logloss: 0.14572	valid_0's auc: 0.849517	valid_1's binary_logloss: 0.155987	valid_1's auc: 0.82788
[4]	valid_0's binary_logloss: 0.142455	valid_0's auc: 0.853918	valid_1's binary_logloss: 0.153089	valid_1's auc: 0.830738
[5]	valid_0's binary_logloss: 0.139735	valid_0's auc: 0.857301	valid_1's binary_logloss: 0.150632	valid_1's auc: 0.834385
[6]	valid_0's binary_logloss: 0.137505	valid_0's auc: 0.860317	valid_1's binary_logloss: 0.148792	valid_1's auc: 0.834978
[7]	valid_0's binary_logloss: 0.135605	valid_0's auc: 0.862342	valid_1's binary_logloss: 0.147286	valid_1's auc: 0.836808
[8]	valid_0's binary_logloss: 0.133938	valid_0's auc: 0.863801	valid_1's binary_logloss: 0.146148	valid_1's auc: 0.836233
[9]	valid_0's binary_logloss: 0.132456	valid_0's auc: 0.865686	valid_1's binary_logloss: 0.145138	valid_1's auc: 0.836224
[10]	valid_0's binary_logloss: 0.131167	valid_0's auc: 0.867095	valid_1's binary_logloss: 0.144312	valid_1's auc: 0.83568
[11]	valid_0's binary_logloss: 0.130032	valid_0's auc: 0.868321	valid_1's binary_logloss: 0.143512	valid_1's auc: 0.836598
[12]	valid_0's binary_logloss: 0.128915	valid_0's auc: 0.870342	valid_1's binary_logloss: 0.142896	valid_1's auc: 0.836786
[13]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.871602	valid_1's binary_logloss: 0.142313	valid_1's auc: 0.837475
[14]	valid_0's binary_logloss: 0.127074	valid_0's auc: 0.873492	valid_1's binary_logloss: 0.141918	valid_1's auc: 0.837308
[15]	valid_0's binary_logloss: 0.126249	valid_0's auc: 0.874714	valid_1's binary_logloss: 0.141545	valid_1's auc: 0.837265
[16]	valid_0's binary_logloss: 0.125412	valid_0's auc: 0.876498	valid_1's binary_logloss: 0.141306	valid_1's auc: 0.837064
[17]	valid_0's binary_logloss: 0.124674	valid_0's auc: 0.877697	valid_1's binary_logloss: 0.141243	valid_1's auc: 0.835667
[18]	valid_0's binary_logloss: 0.124004	valid_0's auc: 0.878754	valid_1's binary_logloss: 0.141001	valid_1's auc: 0.836266
[19]	valid_0's binary_logloss: 0.123324	valid_0's auc: 0.880151	valid_1's binary_logloss: 0.14069	valid_1's auc: 0.836858
[20]	valid_0's binary_logloss: 0.122647	valid_0's auc: 0.88214	valid_1's binary_logloss: 0.140681	valid_1's auc: 0.83574
[21]	valid_0's binary_logloss: 0.12205	valid_0's auc: 0.883119	valid_1's binary_logloss: 0.140627	valid_1's auc: 0.83555
[22]	valid_0's binary_logloss: 0.121526	valid_0's auc: 0.884243	valid_1's binary_logloss: 0.140488	valid_1's auc: 0.83609
[23]	valid_0's binary_logloss: 0.120992	valid_0's auc: 0.885369	valid_1's binary_logloss: 0.140443	valid_1's auc: 0.835781
[24]	valid_0's binary_logloss: 0.120502	valid_0's auc: 0.886215	valid_1's binary_logloss: 0.140363	valid_1's auc: 0.835501
[25]	valid_0's binary_logloss: 0.119975	valid_0's auc: 0.887513	valid_1's binary_logloss: 0.140274	valid_1's auc: 0.835926
[26]	valid_0's binary_logloss: 0.119497	valid_0's auc: 0.888713	valid_1's binary_logloss: 0.140329	valid_1's auc: 0.835254
[27]	valid_0's binary_logloss: 0.11904	valid_0's auc: 0.889795	valid_1's binary_logloss: 0.140341	valid_1's auc: 0.835371
[28]	valid_0's binary_logloss: 0.118653	valid_0's auc: 0.8904	valid_1's binary_logloss: 0.140409	valid_1's auc: 0.834904
[29]	valid_0's binary_logloss: 0.118177	valid_0's auc: 0.891515	valid_1's binary_logloss: 0.14043	valid_1's auc: 0.834421
[30]	valid_0's binary_logloss: 0.117737	valid_0's auc: 0.892538	valid_1's binary_logloss: 0.14048	valid_1's auc: 0.834461
[31]	valid_0's binary_logloss: 0.11742	valid_0's auc: 0.893059	valid_1's binary_logloss: 0.140513	valid_1's auc: 0.834053
[32]	valid_0's binary_logloss: 0.117057	valid_0's auc: 0.893934	valid_1's binary_logloss: 0.140434	valid_1's auc: 0.83418
[33]	valid_0's binary_logloss: 0.116716	valid_0's auc: 0.894932	valid_1's binary_logloss: 0.140491	valid_1's auc: 0.833793
[34]	valid_0's binary_logloss: 0.116371	valid_0's auc: 0.895434	valid_1's binary_logloss: 0.140476	valid_1's auc: 0.834146
[35]	valid_0's binary_logloss: 0.11604	valid_0's auc: 0.896238	valid_1's binary_logloss: 0.140613	valid_1's auc: 0.833608
[36]	valid_0's binary_logloss: 0.115738	valid_0's auc: 0.896761	valid_1's binary_logloss: 0.140566	valid_1's auc: 0.833866
[37]	valid_0's binary_logloss: 0.115445	valid_0's auc: 0.897255	valid_1's binary_logloss: 0.140618	valid_1's auc: 0.833835
[38]	valid_0's binary_logloss: 0.115107	valid_0's auc: 0.897979	valid_1's binary_logloss: 0.14069	valid_1's auc: 0.833409
[39]	valid_0's binary_logloss: 0.114705	valid_0's auc: 0.898947	valid_1's binary_logloss: 0.140754	valid_1's auc: 0.833262
[40]	valid_0's binary_logloss: 0.114409	valid_0's auc: 0.899579	valid_1's binary_logloss: 0.140759	valid_1's auc: 0.833304
[41]	valid_0's binary_logloss: 0.114104	valid_0's auc: 0.900418	valid_1's binary_logloss: 0.140854	valid_1's auc: 0.833244
[42]	valid_0's binary_logloss: 0.113727	valid_0's auc: 0.901143	valid_1's binary_logloss: 0.14096	valid_1's auc: 0.83271
[43]	valid_0's binary_logloss: 0.113493	valid_0's auc: 0.901603	valid_1's binary_logloss: 0.141012	valid_1's auc: 0.832882
Early stopping, best iteration is:
[13]	valid_0's binary_logloss: 0.127987	valid_0's auc: 0.871602	valid_1's binary_logloss: 0.142313	valid_1's auc: 0.837475
[1]	valid_0's binary_logloss: 0.155759	valid_0's auc: 0.830643	valid_1's binary_logloss: 0.164985	valid_1's auc: 0.816734
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.149985	valid_0's auc: 0.839231	valid_1's binary_logloss: 0.159847	valid_1's auc: 0.822161
[3]	valid_0's binary_logloss: 0.14584	valid_0's auc: 0.847482	valid_1's binary_logloss: 0.156209	valid_1's auc: 0.828931
[4]	valid_0's binary_logloss: 0.142477	valid_0's auc: 0.85096	valid_1's binary_logloss: 0.153261	valid_1's auc: 0.83076
[5]	valid_0's binary_logloss: 0.139743	valid_0's auc: 0.854424	valid_1's binary_logloss: 0.150964	valid_1's auc: 0.832373
[6]	valid_0's binary_logloss: 0.137578	valid_0's auc: 0.856208	valid_1's binary_logloss: 0.149014	valid_1's auc: 0.835151
[7]	valid_0's binary_logloss: 0.135714	valid_0's auc: 0.857684	valid_1's binary_logloss: 0.147459	valid_1's auc: 0.836459
[8]	valid_0's binary_logloss: 0.134043	valid_0's auc: 0.859848	valid_1's binary_logloss: 0.146266	valid_1's auc: 0.835502
[9]	valid_0's binary_logloss: 0.132596	valid_0's auc: 0.862422	valid_1's binary_logloss: 0.145301	valid_1's auc: 0.835298
[10]	valid_0's binary_logloss: 0.131312	valid_0's auc: 0.86448	valid_1's binary_logloss: 0.144368	valid_1's auc: 0.836102
[11]	valid_0's binary_logloss: 0.130164	valid_0's auc: 0.86587	valid_1's binary_logloss: 0.14376	valid_1's auc: 0.836347
[12]	valid_0's binary_logloss: 0.129168	valid_0's auc: 0.867975	valid_1's binary_logloss: 0.143155	valid_1's auc: 0.836728
[13]	valid_0's binary_logloss: 0.128157	valid_0's auc: 0.870558	valid_1's binary_logloss: 0.142684	valid_1's auc: 0.836515
[14]	valid_0's binary_logloss: 0.127255	valid_0's auc: 0.872242	valid_1's binary_logloss: 0.142312	valid_1's auc: 0.836322
[15]	valid_0's binary_logloss: 0.126426	valid_0's auc: 0.873758	valid_1's binary_logloss: 0.14194	valid_1's auc: 0.836377
[16]	valid_0's binary_logloss: 0.125659	valid_0's auc: 0.875262	valid_1's binary_logloss: 0.141765	valid_1's auc: 0.835719
[17]	valid_0's binary_logloss: 0.124929	valid_0's auc: 0.876886	valid_1's binary_logloss: 0.141548	valid_1's auc: 0.835566
[18]	valid_0's binary_logloss: 0.124244	valid_0's auc: 0.878549	valid_1's binary_logloss: 0.141281	valid_1's auc: 0.835682
[19]	valid_0's binary_logloss: 0.12357	valid_0's auc: 0.880422	valid_1's binary_logloss: 0.141181	valid_1's auc: 0.835543
[20]	valid_0's binary_logloss: 0.123016	valid_0's auc: 0.881339	valid_1's binary_logloss: 0.140981	valid_1's auc: 0.835789
[21]	valid_0's binary_logloss: 0.12242	valid_0's auc: 0.882595	valid_1's binary_logloss: 0.140807	valid_1's auc: 0.83617
[22]	valid_0's binary_logloss: 0.121854	valid_0's auc: 0.883944	valid_1's binary_logloss: 0.140685	valid_1's auc: 0.835977
[23]	valid_0's binary_logloss: 0.121312	valid_0's auc: 0.884786	valid_1's binary_logloss: 0.140658	valid_1's auc: 0.835988
[24]	valid_0's binary_logloss: 0.120748	valid_0's auc: 0.88598	valid_1's binary_logloss: 0.140629	valid_1's auc: 0.83552
[25]	valid_0's binary_logloss: 0.120274	valid_0's auc: 0.887201	valid_1's binary_logloss: 0.14052	valid_1's auc: 0.835925
[26]	valid_0's binary_logloss: 0.119775	valid_0's auc: 0.888423	valid_1's binary_logloss: 0.140493	valid_1's auc: 0.835694
[27]	valid_0's binary_logloss: 0.119337	valid_0's auc: 0.889313	valid_1's binary_logloss: 0.140489	valid_1's auc: 0.835559
[28]	valid_0's binary_logloss: 0.118884	valid_0's auc: 0.890034	valid_1's binary_logloss: 0.14046	valid_1's auc: 0.835284
[29]	valid_0's binary_logloss: 0.11848	valid_0's auc: 0.890803	valid_1's binary_logloss: 0.14033	valid_1's auc: 0.835875
[30]	valid_0's binary_logloss: 0.118067	valid_0's auc: 0.891689	valid_1's binary_logloss: 0.140375	valid_1's auc: 0.835628
[31]	valid_0's binary_logloss: 0.117678	valid_0's auc: 0.892688	valid_1's binary_logloss: 0.140399	valid_1's auc: 0.835223
[32]	valid_0's binary_logloss: 0.117315	valid_0's auc: 0.893404	valid_1's binary_logloss: 0.140444	valid_1's auc: 0.834945
[33]	valid_0's binary_logloss: 0.116905	valid_0's auc: 0.894165	valid_1's binary_logloss: 0.140407	valid_1's auc: 0.834973
[34]	valid_0's binary_logloss: 0.116504	valid_0's auc: 0.895202	valid_1's binary_logloss: 0.140299	valid_1's auc: 0.835507
[35]	valid_0's binary_logloss: 0.116137	valid_0's auc: 0.896193	valid_1's binary_logloss: 0.140215	valid_1's auc: 0.835906
[36]	valid_0's binary_logloss: 0.115852	valid_0's auc: 0.896674	valid_1's binary_logloss: 0.140177	valid_1's auc: 0.836061
[37]	valid_0's binary_logloss: 0.115534	valid_0's auc: 0.897433	valid_1's binary_logloss: 0.140099	valid_1's auc: 0.836293
[38]	valid_0's binary_logloss: 0.115209	valid_0's auc: 0.897849	valid_1's binary_logloss: 0.140252	valid_1's auc: 0.835887
[39]	valid_0's binary_logloss: 0.114876	valid_0's auc: 0.898318	valid_1's binary_logloss: 0.140398	valid_1's auc: 0.835559
[40]	valid_0's binary_logloss: 0.114599	valid_0's auc: 0.898626	valid_1's binary_logloss: 0.140471	valid_1's auc: 0.835318
[41]	valid_0's binary_logloss: 0.114312	valid_0's auc: 0.899041	valid_1's binary_logloss: 0.140386	valid_1's auc: 0.835822
[42]	valid_0's binary_logloss: 0.114071	valid_0's auc: 0.899694	valid_1's binary_logloss: 0.140332	valid_1's auc: 0.836277
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.129168	valid_0's auc: 0.867975	valid_1's binary_logloss: 0.143155	valid_1's auc: 0.836728
[1]	valid_0's binary_logloss: 0.156222	valid_0's auc: 0.824873	valid_1's binary_logloss: 0.165072	valid_1's auc: 0.817791
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151167	valid_0's auc: 0.82918	valid_1's binary_logloss: 0.160065	valid_1's auc: 0.823351
[3]	valid_0's binary_logloss: 0.147411	valid_0's auc: 0.836091	valid_1's binary_logloss: 0.156507	valid_1's auc: 0.828685
[4]	valid_0's binary_logloss: 0.144503	valid_0's auc: 0.840405	valid_1's binary_logloss: 0.15358	valid_1's auc: 0.833022
[5]	valid_0's binary_logloss: 0.142035	valid_0's auc: 0.843736	valid_1's binary_logloss: 0.151317	valid_1's auc: 0.835479
[6]	valid_0's binary_logloss: 0.140147	valid_0's auc: 0.844764	valid_1's binary_logloss: 0.149464	valid_1's auc: 0.836468
[7]	valid_0's binary_logloss: 0.138474	valid_0's auc: 0.847121	valid_1's binary_logloss: 0.147934	valid_1's auc: 0.836468
[8]	valid_0's binary_logloss: 0.137076	valid_0's auc: 0.847736	valid_1's binary_logloss: 0.146572	valid_1's auc: 0.837728
[9]	valid_0's binary_logloss: 0.13594	valid_0's auc: 0.848495	valid_1's binary_logloss: 0.145536	valid_1's auc: 0.838014
[10]	valid_0's binary_logloss: 0.134871	valid_0's auc: 0.850626	valid_1's binary_logloss: 0.144567	valid_1's auc: 0.838377
[11]	valid_0's binary_logloss: 0.133929	valid_0's auc: 0.851824	valid_1's binary_logloss: 0.1437	valid_1's auc: 0.83854
[12]	valid_0's binary_logloss: 0.133039	valid_0's auc: 0.853454	valid_1's binary_logloss: 0.143056	valid_1's auc: 0.839037
[13]	valid_0's binary_logloss: 0.132319	valid_0's auc: 0.854721	valid_1's binary_logloss: 0.142504	valid_1's auc: 0.838678
[14]	valid_0's binary_logloss: 0.131677	valid_0's auc: 0.85546	valid_1's binary_logloss: 0.142058	valid_1's auc: 0.838268
[15]	valid_0's binary_logloss: 0.131046	valid_0's auc: 0.856819	valid_1's binary_logloss: 0.141834	valid_1's auc: 0.837053
[16]	valid_0's binary_logloss: 0.130517	valid_0's auc: 0.857561	valid_1's binary_logloss: 0.141464	valid_1's auc: 0.83725
[17]	valid_0's binary_logloss: 0.129992	valid_0's auc: 0.858305	valid_1's binary_logloss: 0.141205	valid_1's auc: 0.837057
[18]	valid_0's binary_logloss: 0.129467	valid_0's auc: 0.859993	valid_1's binary_logloss: 0.140976	valid_1's auc: 0.836921
[19]	valid_0's binary_logloss: 0.129012	valid_0's auc: 0.86106	valid_1's binary_logloss: 0.140875	valid_1's auc: 0.83589
[20]	valid_0's binary_logloss: 0.128583	valid_0's auc: 0.862262	valid_1's binary_logloss: 0.140788	valid_1's auc: 0.83514
[21]	valid_0's binary_logloss: 0.128215	valid_0's auc: 0.863124	valid_1's binary_logloss: 0.140701	valid_1's auc: 0.834338
[22]	valid_0's binary_logloss: 0.127857	valid_0's auc: 0.864137	valid_1's binary_logloss: 0.140517	valid_1's auc: 0.834962
[23]	valid_0's binary_logloss: 0.127534	valid_0's auc: 0.864726	valid_1's binary_logloss: 0.140485	valid_1's auc: 0.834234
[24]	valid_0's binary_logloss: 0.127205	valid_0's auc: 0.865628	valid_1's binary_logloss: 0.140477	valid_1's auc: 0.833672
[25]	valid_0's binary_logloss: 0.126836	valid_0's auc: 0.866618	valid_1's binary_logloss: 0.140394	valid_1's auc: 0.833899
[26]	valid_0's binary_logloss: 0.12659	valid_0's auc: 0.867382	valid_1's binary_logloss: 0.140383	valid_1's auc: 0.833512
[27]	valid_0's binary_logloss: 0.126275	valid_0's auc: 0.868358	valid_1's binary_logloss: 0.140387	valid_1's auc: 0.833055
[28]	valid_0's binary_logloss: 0.125976	valid_0's auc: 0.869148	valid_1's binary_logloss: 0.140345	valid_1's auc: 0.832858
[29]	valid_0's binary_logloss: 0.125736	valid_0's auc: 0.869606	valid_1's binary_logloss: 0.140309	valid_1's auc: 0.832855
[30]	valid_0's binary_logloss: 0.125482	valid_0's auc: 0.870141	valid_1's binary_logloss: 0.140261	valid_1's auc: 0.83291
[31]	valid_0's binary_logloss: 0.125141	valid_0's auc: 0.871526	valid_1's binary_logloss: 0.140128	valid_1's auc: 0.833609
[32]	valid_0's binary_logloss: 0.124941	valid_0's auc: 0.871929	valid_1's binary_logloss: 0.14009	valid_1's auc: 0.833536
[33]	valid_0's binary_logloss: 0.124718	valid_0's auc: 0.872798	valid_1's binary_logloss: 0.140121	valid_1's auc: 0.833168
[34]	valid_0's binary_logloss: 0.12451	valid_0's auc: 0.873431	valid_1's binary_logloss: 0.140097	valid_1's auc: 0.833313
[35]	valid_0's binary_logloss: 0.124316	valid_0's auc: 0.873806	valid_1's binary_logloss: 0.140105	valid_1's auc: 0.833176
[36]	valid_0's binary_logloss: 0.124118	valid_0's auc: 0.874204	valid_1's binary_logloss: 0.140129	valid_1's auc: 0.833063
[37]	valid_0's binary_logloss: 0.1239	valid_0's auc: 0.874899	valid_1's binary_logloss: 0.140005	valid_1's auc: 0.83378
[38]	valid_0's binary_logloss: 0.123685	valid_0's auc: 0.875362	valid_1's binary_logloss: 0.140011	valid_1's auc: 0.833865
[39]	valid_0's binary_logloss: 0.123474	valid_0's auc: 0.875966	valid_1's binary_logloss: 0.139979	valid_1's auc: 0.833771
[40]	valid_0's binary_logloss: 0.123322	valid_0's auc: 0.876345	valid_1's binary_logloss: 0.140044	valid_1's auc: 0.833508
[41]	valid_0's binary_logloss: 0.123102	valid_0's auc: 0.876848	valid_1's binary_logloss: 0.139998	valid_1's auc: 0.833816
[42]	valid_0's binary_logloss: 0.12293	valid_0's auc: 0.877347	valid_1's binary_logloss: 0.140003	valid_1's auc: 0.833974
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.133039	valid_0's auc: 0.853454	valid_1's binary_logloss: 0.143056	valid_1's auc: 0.839037
[1]	valid_0's binary_logloss: 0.156466	valid_0's auc: 0.821831	valid_1's binary_logloss: 0.165186	valid_1's auc: 0.817525
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151107	valid_0's auc: 0.830001	valid_1's binary_logloss: 0.15968	valid_1's auc: 0.82337
[3]	valid_0's binary_logloss: 0.147324	valid_0's auc: 0.839573	valid_1's binary_logloss: 0.156063	valid_1's auc: 0.83264
[4]	valid_0's binary_logloss: 0.144391	valid_0's auc: 0.842992	valid_1's binary_logloss: 0.153143	valid_1's auc: 0.83608
[5]	valid_0's binary_logloss: 0.141966	valid_0's auc: 0.845713	valid_1's binary_logloss: 0.150779	valid_1's auc: 0.838479
[6]	valid_0's binary_logloss: 0.139952	valid_0's auc: 0.848508	valid_1's binary_logloss: 0.149011	valid_1's auc: 0.840056
[7]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.850111	valid_1's binary_logloss: 0.147468	valid_1's auc: 0.840232
[8]	valid_0's binary_logloss: 0.136906	valid_0's auc: 0.851973	valid_1's binary_logloss: 0.146195	valid_1's auc: 0.839018
[9]	valid_0's binary_logloss: 0.135643	valid_0's auc: 0.8532	valid_1's binary_logloss: 0.145217	valid_1's auc: 0.838064
[10]	valid_0's binary_logloss: 0.134586	valid_0's auc: 0.85447	valid_1's binary_logloss: 0.144268	valid_1's auc: 0.838205
[11]	valid_0's binary_logloss: 0.133674	valid_0's auc: 0.855157	valid_1's binary_logloss: 0.14353	valid_1's auc: 0.837983
[12]	valid_0's binary_logloss: 0.132856	valid_0's auc: 0.856252	valid_1's binary_logloss: 0.142891	valid_1's auc: 0.83809
[13]	valid_0's binary_logloss: 0.132111	valid_0's auc: 0.857161	valid_1's binary_logloss: 0.142263	valid_1's auc: 0.838622
[14]	valid_0's binary_logloss: 0.131389	valid_0's auc: 0.857996	valid_1's binary_logloss: 0.141727	valid_1's auc: 0.839052
[15]	valid_0's binary_logloss: 0.130739	valid_0's auc: 0.859511	valid_1's binary_logloss: 0.141355	valid_1's auc: 0.839062
[16]	valid_0's binary_logloss: 0.130175	valid_0's auc: 0.860457	valid_1's binary_logloss: 0.141072	valid_1's auc: 0.838898
[17]	valid_0's binary_logloss: 0.129656	valid_0's auc: 0.861101	valid_1's binary_logloss: 0.140731	valid_1's auc: 0.838785
[18]	valid_0's binary_logloss: 0.12915	valid_0's auc: 0.862022	valid_1's binary_logloss: 0.140433	valid_1's auc: 0.839358
[19]	valid_0's binary_logloss: 0.128659	valid_0's auc: 0.863252	valid_1's binary_logloss: 0.140181	valid_1's auc: 0.839999
[20]	valid_0's binary_logloss: 0.128254	valid_0's auc: 0.863823	valid_1's binary_logloss: 0.139974	valid_1's auc: 0.840096
[21]	valid_0's binary_logloss: 0.127855	valid_0's auc: 0.864524	valid_1's binary_logloss: 0.139827	valid_1's auc: 0.840183
[22]	valid_0's binary_logloss: 0.127461	valid_0's auc: 0.865553	valid_1's binary_logloss: 0.139714	valid_1's auc: 0.840042
[23]	valid_0's binary_logloss: 0.127109	valid_0's auc: 0.866427	valid_1's binary_logloss: 0.13974	valid_1's auc: 0.839501
[24]	valid_0's binary_logloss: 0.126769	valid_0's auc: 0.86716	valid_1's binary_logloss: 0.13959	valid_1's auc: 0.83965
[25]	valid_0's binary_logloss: 0.126454	valid_0's auc: 0.868035	valid_1's binary_logloss: 0.139583	valid_1's auc: 0.839131
[26]	valid_0's binary_logloss: 0.126125	valid_0's auc: 0.869021	valid_1's binary_logloss: 0.139492	valid_1's auc: 0.839022
[27]	valid_0's binary_logloss: 0.125839	valid_0's auc: 0.869695	valid_1's binary_logloss: 0.139453	valid_1's auc: 0.839262
[28]	valid_0's binary_logloss: 0.125557	valid_0's auc: 0.870113	valid_1's binary_logloss: 0.139366	valid_1's auc: 0.839245
[29]	valid_0's binary_logloss: 0.125297	valid_0's auc: 0.870833	valid_1's binary_logloss: 0.139358	valid_1's auc: 0.839149
[30]	valid_0's binary_logloss: 0.125018	valid_0's auc: 0.871919	valid_1's binary_logloss: 0.139376	valid_1's auc: 0.838964
[31]	valid_0's binary_logloss: 0.12476	valid_0's auc: 0.872636	valid_1's binary_logloss: 0.139326	valid_1's auc: 0.838793
[32]	valid_0's binary_logloss: 0.124553	valid_0's auc: 0.87325	valid_1's binary_logloss: 0.13928	valid_1's auc: 0.83903
[33]	valid_0's binary_logloss: 0.124351	valid_0's auc: 0.87392	valid_1's binary_logloss: 0.13927	valid_1's auc: 0.838933
[34]	valid_0's binary_logloss: 0.124137	valid_0's auc: 0.874695	valid_1's binary_logloss: 0.13921	valid_1's auc: 0.839081
[35]	valid_0's binary_logloss: 0.123965	valid_0's auc: 0.875082	valid_1's binary_logloss: 0.139215	valid_1's auc: 0.839016
[36]	valid_0's binary_logloss: 0.123737	valid_0's auc: 0.875729	valid_1's binary_logloss: 0.139225	valid_1's auc: 0.839216
[37]	valid_0's binary_logloss: 0.123474	valid_0's auc: 0.876555	valid_1's binary_logloss: 0.139239	valid_1's auc: 0.839126
Early stopping, best iteration is:
[7]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.850111	valid_1's binary_logloss: 0.147468	valid_1's auc: 0.840232
[1]	valid_0's binary_logloss: 0.156592	valid_0's auc: 0.821427	valid_1's binary_logloss: 0.165273	valid_1's auc: 0.81711
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151337	valid_0's auc: 0.827905	valid_1's binary_logloss: 0.160211	valid_1's auc: 0.82145
[3]	valid_0's binary_logloss: 0.147478	valid_0's auc: 0.837862	valid_1's binary_logloss: 0.156489	valid_1's auc: 0.828696
[4]	valid_0's binary_logloss: 0.144436	valid_0's auc: 0.840611	valid_1's binary_logloss: 0.153536	valid_1's auc: 0.831962
[5]	valid_0's binary_logloss: 0.142075	valid_0's auc: 0.843113	valid_1's binary_logloss: 0.151214	valid_1's auc: 0.834308
[6]	valid_0's binary_logloss: 0.140098	valid_0's auc: 0.84374	valid_1's binary_logloss: 0.149386	valid_1's auc: 0.834377
[7]	valid_0's binary_logloss: 0.138482	valid_0's auc: 0.845284	valid_1's binary_logloss: 0.147794	valid_1's auc: 0.835936
[8]	valid_0's binary_logloss: 0.137121	valid_0's auc: 0.847226	valid_1's binary_logloss: 0.146629	valid_1's auc: 0.836079
[9]	valid_0's binary_logloss: 0.135919	valid_0's auc: 0.850143	valid_1's binary_logloss: 0.145692	valid_1's auc: 0.835641
[10]	valid_0's binary_logloss: 0.134841	valid_0's auc: 0.851387	valid_1's binary_logloss: 0.144896	valid_1's auc: 0.835182
[11]	valid_0's binary_logloss: 0.133863	valid_0's auc: 0.852703	valid_1's binary_logloss: 0.144127	valid_1's auc: 0.835457
[12]	valid_0's binary_logloss: 0.133034	valid_0's auc: 0.854998	valid_1's binary_logloss: 0.143464	valid_1's auc: 0.836932
[13]	valid_0's binary_logloss: 0.132288	valid_0's auc: 0.856458	valid_1's binary_logloss: 0.143031	valid_1's auc: 0.836525
[14]	valid_0's binary_logloss: 0.131588	valid_0's auc: 0.857578	valid_1's binary_logloss: 0.142638	valid_1's auc: 0.836371
[15]	valid_0's binary_logloss: 0.130965	valid_0's auc: 0.858803	valid_1's binary_logloss: 0.142207	valid_1's auc: 0.836382
[16]	valid_0's binary_logloss: 0.13041	valid_0's auc: 0.859796	valid_1's binary_logloss: 0.141782	valid_1's auc: 0.836831
[17]	valid_0's binary_logloss: 0.129932	valid_0's auc: 0.860226	valid_1's binary_logloss: 0.141442	valid_1's auc: 0.837028
[18]	valid_0's binary_logloss: 0.129486	valid_0's auc: 0.861152	valid_1's binary_logloss: 0.141159	valid_1's auc: 0.837531
[19]	valid_0's binary_logloss: 0.129003	valid_0's auc: 0.862227	valid_1's binary_logloss: 0.140963	valid_1's auc: 0.837295
[20]	valid_0's binary_logloss: 0.12855	valid_0's auc: 0.863276	valid_1's binary_logloss: 0.140751	valid_1's auc: 0.837772
[21]	valid_0's binary_logloss: 0.128139	valid_0's auc: 0.864197	valid_1's binary_logloss: 0.140652	valid_1's auc: 0.837784
[22]	valid_0's binary_logloss: 0.12775	valid_0's auc: 0.865145	valid_1's binary_logloss: 0.140483	valid_1's auc: 0.837974
[23]	valid_0's binary_logloss: 0.127368	valid_0's auc: 0.865962	valid_1's binary_logloss: 0.140367	valid_1's auc: 0.837557
[24]	valid_0's binary_logloss: 0.127008	valid_0's auc: 0.866988	valid_1's binary_logloss: 0.140316	valid_1's auc: 0.837021
[25]	valid_0's binary_logloss: 0.12663	valid_0's auc: 0.868263	valid_1's binary_logloss: 0.140197	valid_1's auc: 0.837265
[26]	valid_0's binary_logloss: 0.126317	valid_0's auc: 0.868968	valid_1's binary_logloss: 0.140127	valid_1's auc: 0.836987
[27]	valid_0's binary_logloss: 0.126031	valid_0's auc: 0.869684	valid_1's binary_logloss: 0.140054	valid_1's auc: 0.837221
[28]	valid_0's binary_logloss: 0.125747	valid_0's auc: 0.870355	valid_1's binary_logloss: 0.13997	valid_1's auc: 0.837362
[29]	valid_0's binary_logloss: 0.12547	valid_0's auc: 0.871186	valid_1's binary_logloss: 0.139918	valid_1's auc: 0.837231
[30]	valid_0's binary_logloss: 0.125224	valid_0's auc: 0.871902	valid_1's binary_logloss: 0.139873	valid_1's auc: 0.837133
[31]	valid_0's binary_logloss: 0.124989	valid_0's auc: 0.872311	valid_1's binary_logloss: 0.139847	valid_1's auc: 0.83717
[32]	valid_0's binary_logloss: 0.12477	valid_0's auc: 0.872917	valid_1's binary_logloss: 0.139784	valid_1's auc: 0.837439
[33]	valid_0's binary_logloss: 0.12454	valid_0's auc: 0.873431	valid_1's binary_logloss: 0.139749	valid_1's auc: 0.837452
[34]	valid_0's binary_logloss: 0.124274	valid_0's auc: 0.874128	valid_1's binary_logloss: 0.139762	valid_1's auc: 0.837524
[35]	valid_0's binary_logloss: 0.12402	valid_0's auc: 0.874804	valid_1's binary_logloss: 0.139751	valid_1's auc: 0.837469
[36]	valid_0's binary_logloss: 0.123792	valid_0's auc: 0.875352	valid_1's binary_logloss: 0.139769	valid_1's auc: 0.83736
[37]	valid_0's binary_logloss: 0.123559	valid_0's auc: 0.87599	valid_1's binary_logloss: 0.139757	valid_1's auc: 0.837238
[38]	valid_0's binary_logloss: 0.123367	valid_0's auc: 0.876681	valid_1's binary_logloss: 0.139742	valid_1's auc: 0.837375
[39]	valid_0's binary_logloss: 0.123176	valid_0's auc: 0.877229	valid_1's binary_logloss: 0.139777	valid_1's auc: 0.837053
[40]	valid_0's binary_logloss: 0.122931	valid_0's auc: 0.877783	valid_1's binary_logloss: 0.139728	valid_1's auc: 0.837245
[41]	valid_0's binary_logloss: 0.122698	valid_0's auc: 0.878412	valid_1's binary_logloss: 0.139754	valid_1's auc: 0.837189
[42]	valid_0's binary_logloss: 0.122487	valid_0's auc: 0.879389	valid_1's binary_logloss: 0.139729	valid_1's auc: 0.837385
[43]	valid_0's binary_logloss: 0.122278	valid_0's auc: 0.879887	valid_1's binary_logloss: 0.139768	valid_1's auc: 0.83703
[44]	valid_0's binary_logloss: 0.12209	valid_0's auc: 0.880265	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.837043
[45]	valid_0's binary_logloss: 0.121908	valid_0's auc: 0.880695	valid_1's binary_logloss: 0.139671	valid_1's auc: 0.837265
[46]	valid_0's binary_logloss: 0.121712	valid_0's auc: 0.881124	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.837228
[47]	valid_0's binary_logloss: 0.121548	valid_0's auc: 0.881391	valid_1's binary_logloss: 0.139699	valid_1's auc: 0.837146
[48]	valid_0's binary_logloss: 0.121346	valid_0's auc: 0.881926	valid_1's binary_logloss: 0.139641	valid_1's auc: 0.837387
[49]	valid_0's binary_logloss: 0.121183	valid_0's auc: 0.882497	valid_1's binary_logloss: 0.13965	valid_1's auc: 0.837464
[50]	valid_0's binary_logloss: 0.121013	valid_0's auc: 0.882962	valid_1's binary_logloss: 0.139684	valid_1's auc: 0.837347
[51]	valid_0's binary_logloss: 0.120868	valid_0's auc: 0.883328	valid_1's binary_logloss: 0.139662	valid_1's auc: 0.837533
[52]	valid_0's binary_logloss: 0.12066	valid_0's auc: 0.883845	valid_1's binary_logloss: 0.139589	valid_1's auc: 0.838071
[53]	valid_0's binary_logloss: 0.120503	valid_0's auc: 0.884228	valid_1's binary_logloss: 0.139593	valid_1's auc: 0.837994
[54]	valid_0's binary_logloss: 0.120376	valid_0's auc: 0.884403	valid_1's binary_logloss: 0.139642	valid_1's auc: 0.837897
[55]	valid_0's binary_logloss: 0.120214	valid_0's auc: 0.884574	valid_1's binary_logloss: 0.139613	valid_1's auc: 0.838054
[56]	valid_0's binary_logloss: 0.120016	valid_0's auc: 0.885034	valid_1's binary_logloss: 0.139564	valid_1's auc: 0.838201
[57]	valid_0's binary_logloss: 0.119848	valid_0's auc: 0.885329	valid_1's binary_logloss: 0.139573	valid_1's auc: 0.838183
[58]	valid_0's binary_logloss: 0.119733	valid_0's auc: 0.885429	valid_1's binary_logloss: 0.139566	valid_1's auc: 0.838352
[59]	valid_0's binary_logloss: 0.119583	valid_0's auc: 0.885751	valid_1's binary_logloss: 0.139641	valid_1's auc: 0.838177
[60]	valid_0's binary_logloss: 0.119461	valid_0's auc: 0.885952	valid_1's binary_logloss: 0.139615	valid_1's auc: 0.838373
[61]	valid_0's binary_logloss: 0.119357	valid_0's auc: 0.886123	valid_1's binary_logloss: 0.139644	valid_1's auc: 0.838135
[62]	valid_0's binary_logloss: 0.119218	valid_0's auc: 0.886592	valid_1's binary_logloss: 0.139648	valid_1's auc: 0.83826
[63]	valid_0's binary_logloss: 0.11911	valid_0's auc: 0.886712	valid_1's binary_logloss: 0.139729	valid_1's auc: 0.838084
[64]	valid_0's binary_logloss: 0.119003	valid_0's auc: 0.886807	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.838391
[65]	valid_0's binary_logloss: 0.11888	valid_0's auc: 0.887021	valid_1's binary_logloss: 0.13972	valid_1's auc: 0.838343
[66]	valid_0's binary_logloss: 0.118728	valid_0's auc: 0.88734	valid_1's binary_logloss: 0.139788	valid_1's auc: 0.838004
[67]	valid_0's binary_logloss: 0.118646	valid_0's auc: 0.887341	valid_1's binary_logloss: 0.139839	valid_1's auc: 0.837935
[68]	valid_0's binary_logloss: 0.118505	valid_0's auc: 0.887601	valid_1's binary_logloss: 0.139839	valid_1's auc: 0.837981
[69]	valid_0's binary_logloss: 0.11833	valid_0's auc: 0.887954	valid_1's binary_logloss: 0.139867	valid_1's auc: 0.83787
[70]	valid_0's binary_logloss: 0.118209	valid_0's auc: 0.888114	valid_1's binary_logloss: 0.139919	valid_1's auc: 0.837718
[71]	valid_0's binary_logloss: 0.118049	valid_0's auc: 0.888481	valid_1's binary_logloss: 0.139893	valid_1's auc: 0.837821
[72]	valid_0's binary_logloss: 0.117903	valid_0's auc: 0.888835	valid_1's binary_logloss: 0.139952	valid_1's auc: 0.837731
[73]	valid_0's binary_logloss: 0.117758	valid_0's auc: 0.889134	valid_1's binary_logloss: 0.139962	valid_1's auc: 0.837899
[74]	valid_0's binary_logloss: 0.117691	valid_0's auc: 0.889144	valid_1's binary_logloss: 0.13998	valid_1's auc: 0.83792
[75]	valid_0's binary_logloss: 0.117578	valid_0's auc: 0.889275	valid_1's binary_logloss: 0.139953	valid_1's auc: 0.838045
[76]	valid_0's binary_logloss: 0.117479	valid_0's auc: 0.88948	valid_1's binary_logloss: 0.140036	valid_1's auc: 0.837718
[77]	valid_0's binary_logloss: 0.117401	valid_0's auc: 0.889549	valid_1's binary_logloss: 0.140101	valid_1's auc: 0.837554
[78]	valid_0's binary_logloss: 0.117323	valid_0's auc: 0.889594	valid_1's binary_logloss: 0.140162	valid_1's auc: 0.837358
[79]	valid_0's binary_logloss: 0.117242	valid_0's auc: 0.889725	valid_1's binary_logloss: 0.140191	valid_1's auc: 0.837296
[80]	valid_0's binary_logloss: 0.117092	valid_0's auc: 0.890095	valid_1's binary_logloss: 0.140182	valid_1's auc: 0.837436
[81]	valid_0's binary_logloss: 0.116991	valid_0's auc: 0.890237	valid_1's binary_logloss: 0.140185	valid_1's auc: 0.837617
[82]	valid_0's binary_logloss: 0.116893	valid_0's auc: 0.89035	valid_1's binary_logloss: 0.140191	valid_1's auc: 0.837676
[83]	valid_0's binary_logloss: 0.116801	valid_0's auc: 0.890464	valid_1's binary_logloss: 0.140249	valid_1's auc: 0.837537
[84]	valid_0's binary_logloss: 0.116619	valid_0's auc: 0.890869	valid_1's binary_logloss: 0.140263	valid_1's auc: 0.837565
[85]	valid_0's binary_logloss: 0.116509	valid_0's auc: 0.891174	valid_1's binary_logloss: 0.140345	valid_1's auc: 0.837241
[86]	valid_0's binary_logloss: 0.116424	valid_0's auc: 0.891255	valid_1's binary_logloss: 0.140382	valid_1's auc: 0.837141
Early stopping, best iteration is:
[56]	valid_0's binary_logloss: 0.120016	valid_0's auc: 0.885034	valid_1's binary_logloss: 0.139564	valid_1's auc: 0.838201
[1]	valid_0's binary_logloss: 0.156222	valid_0's auc: 0.824873	valid_1's binary_logloss: 0.165072	valid_1's auc: 0.817791
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151167	valid_0's auc: 0.82918	valid_1's binary_logloss: 0.160065	valid_1's auc: 0.823351
[3]	valid_0's binary_logloss: 0.147411	valid_0's auc: 0.836091	valid_1's binary_logloss: 0.156507	valid_1's auc: 0.828685
[4]	valid_0's binary_logloss: 0.144503	valid_0's auc: 0.840405	valid_1's binary_logloss: 0.15358	valid_1's auc: 0.833022
[5]	valid_0's binary_logloss: 0.142035	valid_0's auc: 0.843736	valid_1's binary_logloss: 0.151317	valid_1's auc: 0.835479
[6]	valid_0's binary_logloss: 0.140147	valid_0's auc: 0.844764	valid_1's binary_logloss: 0.149464	valid_1's auc: 0.836468
[7]	valid_0's binary_logloss: 0.138474	valid_0's auc: 0.847121	valid_1's binary_logloss: 0.147934	valid_1's auc: 0.836468
[8]	valid_0's binary_logloss: 0.137076	valid_0's auc: 0.847736	valid_1's binary_logloss: 0.146572	valid_1's auc: 0.837728
[9]	valid_0's binary_logloss: 0.13594	valid_0's auc: 0.848495	valid_1's binary_logloss: 0.145536	valid_1's auc: 0.838014
[10]	valid_0's binary_logloss: 0.134871	valid_0's auc: 0.850626	valid_1's binary_logloss: 0.144567	valid_1's auc: 0.838377
[11]	valid_0's binary_logloss: 0.133929	valid_0's auc: 0.851824	valid_1's binary_logloss: 0.1437	valid_1's auc: 0.83854
[12]	valid_0's binary_logloss: 0.133039	valid_0's auc: 0.853454	valid_1's binary_logloss: 0.143056	valid_1's auc: 0.839037
[13]	valid_0's binary_logloss: 0.132319	valid_0's auc: 0.854721	valid_1's binary_logloss: 0.142504	valid_1's auc: 0.838678
[14]	valid_0's binary_logloss: 0.131677	valid_0's auc: 0.85546	valid_1's binary_logloss: 0.142058	valid_1's auc: 0.838268
[15]	valid_0's binary_logloss: 0.131046	valid_0's auc: 0.856819	valid_1's binary_logloss: 0.141834	valid_1's auc: 0.837053
[16]	valid_0's binary_logloss: 0.130517	valid_0's auc: 0.857561	valid_1's binary_logloss: 0.141464	valid_1's auc: 0.83725
[17]	valid_0's binary_logloss: 0.129992	valid_0's auc: 0.858305	valid_1's binary_logloss: 0.141205	valid_1's auc: 0.837057
[18]	valid_0's binary_logloss: 0.129467	valid_0's auc: 0.859993	valid_1's binary_logloss: 0.140976	valid_1's auc: 0.836921
[19]	valid_0's binary_logloss: 0.129012	valid_0's auc: 0.86106	valid_1's binary_logloss: 0.140875	valid_1's auc: 0.83589
[20]	valid_0's binary_logloss: 0.128583	valid_0's auc: 0.862262	valid_1's binary_logloss: 0.140788	valid_1's auc: 0.83514
[21]	valid_0's binary_logloss: 0.128215	valid_0's auc: 0.863124	valid_1's binary_logloss: 0.140701	valid_1's auc: 0.834338
[22]	valid_0's binary_logloss: 0.127857	valid_0's auc: 0.864137	valid_1's binary_logloss: 0.140517	valid_1's auc: 0.834962
[23]	valid_0's binary_logloss: 0.127534	valid_0's auc: 0.864726	valid_1's binary_logloss: 0.140485	valid_1's auc: 0.834234
[24]	valid_0's binary_logloss: 0.127205	valid_0's auc: 0.865628	valid_1's binary_logloss: 0.140477	valid_1's auc: 0.833672
[25]	valid_0's binary_logloss: 0.126836	valid_0's auc: 0.866618	valid_1's binary_logloss: 0.140394	valid_1's auc: 0.833899
[26]	valid_0's binary_logloss: 0.12659	valid_0's auc: 0.867382	valid_1's binary_logloss: 0.140383	valid_1's auc: 0.833512
[27]	valid_0's binary_logloss: 0.126275	valid_0's auc: 0.868358	valid_1's binary_logloss: 0.140387	valid_1's auc: 0.833055
[28]	valid_0's binary_logloss: 0.125976	valid_0's auc: 0.869148	valid_1's binary_logloss: 0.140345	valid_1's auc: 0.832858
[29]	valid_0's binary_logloss: 0.125736	valid_0's auc: 0.869606	valid_1's binary_logloss: 0.140309	valid_1's auc: 0.832855
[30]	valid_0's binary_logloss: 0.125482	valid_0's auc: 0.870141	valid_1's binary_logloss: 0.140261	valid_1's auc: 0.83291
[31]	valid_0's binary_logloss: 0.125141	valid_0's auc: 0.871526	valid_1's binary_logloss: 0.140128	valid_1's auc: 0.833609
[32]	valid_0's binary_logloss: 0.124941	valid_0's auc: 0.871929	valid_1's binary_logloss: 0.14009	valid_1's auc: 0.833536
[33]	valid_0's binary_logloss: 0.124718	valid_0's auc: 0.872798	valid_1's binary_logloss: 0.140121	valid_1's auc: 0.833168
[34]	valid_0's binary_logloss: 0.12451	valid_0's auc: 0.873431	valid_1's binary_logloss: 0.140097	valid_1's auc: 0.833313
[35]	valid_0's binary_logloss: 0.124316	valid_0's auc: 0.873806	valid_1's binary_logloss: 0.140105	valid_1's auc: 0.833176
[36]	valid_0's binary_logloss: 0.124118	valid_0's auc: 0.874204	valid_1's binary_logloss: 0.140129	valid_1's auc: 0.833063
[37]	valid_0's binary_logloss: 0.1239	valid_0's auc: 0.874899	valid_1's binary_logloss: 0.140005	valid_1's auc: 0.83378
[38]	valid_0's binary_logloss: 0.123685	valid_0's auc: 0.875362	valid_1's binary_logloss: 0.140011	valid_1's auc: 0.833865
[39]	valid_0's binary_logloss: 0.123474	valid_0's auc: 0.875966	valid_1's binary_logloss: 0.139979	valid_1's auc: 0.833771
[40]	valid_0's binary_logloss: 0.123322	valid_0's auc: 0.876345	valid_1's binary_logloss: 0.140044	valid_1's auc: 0.833508
[41]	valid_0's binary_logloss: 0.123102	valid_0's auc: 0.876848	valid_1's binary_logloss: 0.139998	valid_1's auc: 0.833816
[42]	valid_0's binary_logloss: 0.12293	valid_0's auc: 0.877347	valid_1's binary_logloss: 0.140003	valid_1's auc: 0.833974
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.133039	valid_0's auc: 0.853454	valid_1's binary_logloss: 0.143056	valid_1's auc: 0.839037
[1]	valid_0's binary_logloss: 0.156466	valid_0's auc: 0.821831	valid_1's binary_logloss: 0.165186	valid_1's auc: 0.817525
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151107	valid_0's auc: 0.830001	valid_1's binary_logloss: 0.15968	valid_1's auc: 0.82337
[3]	valid_0's binary_logloss: 0.147324	valid_0's auc: 0.839573	valid_1's binary_logloss: 0.156063	valid_1's auc: 0.83264
[4]	valid_0's binary_logloss: 0.144391	valid_0's auc: 0.842992	valid_1's binary_logloss: 0.153143	valid_1's auc: 0.83608
[5]	valid_0's binary_logloss: 0.141966	valid_0's auc: 0.845713	valid_1's binary_logloss: 0.150779	valid_1's auc: 0.838479
[6]	valid_0's binary_logloss: 0.139952	valid_0's auc: 0.848508	valid_1's binary_logloss: 0.149011	valid_1's auc: 0.840056
[7]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.850111	valid_1's binary_logloss: 0.147468	valid_1's auc: 0.840232
[8]	valid_0's binary_logloss: 0.136906	valid_0's auc: 0.851973	valid_1's binary_logloss: 0.146195	valid_1's auc: 0.839018
[9]	valid_0's binary_logloss: 0.135643	valid_0's auc: 0.8532	valid_1's binary_logloss: 0.145217	valid_1's auc: 0.838064
[10]	valid_0's binary_logloss: 0.134586	valid_0's auc: 0.85447	valid_1's binary_logloss: 0.144268	valid_1's auc: 0.838205
[11]	valid_0's binary_logloss: 0.133674	valid_0's auc: 0.855157	valid_1's binary_logloss: 0.14353	valid_1's auc: 0.837983
[12]	valid_0's binary_logloss: 0.132856	valid_0's auc: 0.856252	valid_1's binary_logloss: 0.142891	valid_1's auc: 0.83809
[13]	valid_0's binary_logloss: 0.132111	valid_0's auc: 0.857161	valid_1's binary_logloss: 0.142263	valid_1's auc: 0.838622
[14]	valid_0's binary_logloss: 0.131389	valid_0's auc: 0.857996	valid_1's binary_logloss: 0.141727	valid_1's auc: 0.839052
[15]	valid_0's binary_logloss: 0.130739	valid_0's auc: 0.859511	valid_1's binary_logloss: 0.141355	valid_1's auc: 0.839062
[16]	valid_0's binary_logloss: 0.130175	valid_0's auc: 0.860457	valid_1's binary_logloss: 0.141072	valid_1's auc: 0.838898
[17]	valid_0's binary_logloss: 0.129656	valid_0's auc: 0.861101	valid_1's binary_logloss: 0.140731	valid_1's auc: 0.838785
[18]	valid_0's binary_logloss: 0.12915	valid_0's auc: 0.862022	valid_1's binary_logloss: 0.140433	valid_1's auc: 0.839358
[19]	valid_0's binary_logloss: 0.128659	valid_0's auc: 0.863252	valid_1's binary_logloss: 0.140181	valid_1's auc: 0.839999
[20]	valid_0's binary_logloss: 0.128254	valid_0's auc: 0.863823	valid_1's binary_logloss: 0.139974	valid_1's auc: 0.840096
[21]	valid_0's binary_logloss: 0.127855	valid_0's auc: 0.864524	valid_1's binary_logloss: 0.139827	valid_1's auc: 0.840183
[22]	valid_0's binary_logloss: 0.127461	valid_0's auc: 0.865553	valid_1's binary_logloss: 0.139714	valid_1's auc: 0.840042
[23]	valid_0's binary_logloss: 0.127109	valid_0's auc: 0.866427	valid_1's binary_logloss: 0.13974	valid_1's auc: 0.839501
[24]	valid_0's binary_logloss: 0.126769	valid_0's auc: 0.86716	valid_1's binary_logloss: 0.13959	valid_1's auc: 0.83965
[25]	valid_0's binary_logloss: 0.126454	valid_0's auc: 0.868035	valid_1's binary_logloss: 0.139583	valid_1's auc: 0.839131
[26]	valid_0's binary_logloss: 0.126125	valid_0's auc: 0.869021	valid_1's binary_logloss: 0.139492	valid_1's auc: 0.839022
[27]	valid_0's binary_logloss: 0.125839	valid_0's auc: 0.869695	valid_1's binary_logloss: 0.139453	valid_1's auc: 0.839262
[28]	valid_0's binary_logloss: 0.125557	valid_0's auc: 0.870113	valid_1's binary_logloss: 0.139366	valid_1's auc: 0.839245
[29]	valid_0's binary_logloss: 0.125297	valid_0's auc: 0.870833	valid_1's binary_logloss: 0.139358	valid_1's auc: 0.839149
[30]	valid_0's binary_logloss: 0.125018	valid_0's auc: 0.871919	valid_1's binary_logloss: 0.139376	valid_1's auc: 0.838964
[31]	valid_0's binary_logloss: 0.12476	valid_0's auc: 0.872636	valid_1's binary_logloss: 0.139326	valid_1's auc: 0.838793
[32]	valid_0's binary_logloss: 0.124553	valid_0's auc: 0.87325	valid_1's binary_logloss: 0.13928	valid_1's auc: 0.83903
[33]	valid_0's binary_logloss: 0.124351	valid_0's auc: 0.87392	valid_1's binary_logloss: 0.13927	valid_1's auc: 0.838933
[34]	valid_0's binary_logloss: 0.124137	valid_0's auc: 0.874695	valid_1's binary_logloss: 0.13921	valid_1's auc: 0.839081
[35]	valid_0's binary_logloss: 0.123965	valid_0's auc: 0.875082	valid_1's binary_logloss: 0.139215	valid_1's auc: 0.839016
[36]	valid_0's binary_logloss: 0.123737	valid_0's auc: 0.875729	valid_1's binary_logloss: 0.139225	valid_1's auc: 0.839216
[37]	valid_0's binary_logloss: 0.123474	valid_0's auc: 0.876555	valid_1's binary_logloss: 0.139239	valid_1's auc: 0.839126
Early stopping, best iteration is:
[7]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.850111	valid_1's binary_logloss: 0.147468	valid_1's auc: 0.840232
[1]	valid_0's binary_logloss: 0.156592	valid_0's auc: 0.821427	valid_1's binary_logloss: 0.165273	valid_1's auc: 0.81711
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.151337	valid_0's auc: 0.827905	valid_1's binary_logloss: 0.160211	valid_1's auc: 0.82145
[3]	valid_0's binary_logloss: 0.147478	valid_0's auc: 0.837862	valid_1's binary_logloss: 0.156489	valid_1's auc: 0.828696
[4]	valid_0's binary_logloss: 0.144436	valid_0's auc: 0.840611	valid_1's binary_logloss: 0.153536	valid_1's auc: 0.831962
[5]	valid_0's binary_logloss: 0.142075	valid_0's auc: 0.843113	valid_1's binary_logloss: 0.151214	valid_1's auc: 0.834308
[6]	valid_0's binary_logloss: 0.140098	valid_0's auc: 0.84374	valid_1's binary_logloss: 0.149386	valid_1's auc: 0.834377
[7]	valid_0's binary_logloss: 0.138482	valid_0's auc: 0.845284	valid_1's binary_logloss: 0.147794	valid_1's auc: 0.835936
[8]	valid_0's binary_logloss: 0.137121	valid_0's auc: 0.847226	valid_1's binary_logloss: 0.146629	valid_1's auc: 0.836079
[9]	valid_0's binary_logloss: 0.135919	valid_0's auc: 0.850143	valid_1's binary_logloss: 0.145692	valid_1's auc: 0.835641
[10]	valid_0's binary_logloss: 0.134841	valid_0's auc: 0.851387	valid_1's binary_logloss: 0.144896	valid_1's auc: 0.835182
[11]	valid_0's binary_logloss: 0.133863	valid_0's auc: 0.852703	valid_1's binary_logloss: 0.144127	valid_1's auc: 0.835457
[12]	valid_0's binary_logloss: 0.133034	valid_0's auc: 0.854998	valid_1's binary_logloss: 0.143464	valid_1's auc: 0.836932
[13]	valid_0's binary_logloss: 0.132288	valid_0's auc: 0.856458	valid_1's binary_logloss: 0.143031	valid_1's auc: 0.836525
[14]	valid_0's binary_logloss: 0.131588	valid_0's auc: 0.857578	valid_1's binary_logloss: 0.142638	valid_1's auc: 0.836371
[15]	valid_0's binary_logloss: 0.130965	valid_0's auc: 0.858803	valid_1's binary_logloss: 0.142207	valid_1's auc: 0.836382
[16]	valid_0's binary_logloss: 0.13041	valid_0's auc: 0.859796	valid_1's binary_logloss: 0.141782	valid_1's auc: 0.836831
[17]	valid_0's binary_logloss: 0.129932	valid_0's auc: 0.860226	valid_1's binary_logloss: 0.141442	valid_1's auc: 0.837028
[18]	valid_0's binary_logloss: 0.129486	valid_0's auc: 0.861152	valid_1's binary_logloss: 0.141159	valid_1's auc: 0.837531
[19]	valid_0's binary_logloss: 0.129003	valid_0's auc: 0.862227	valid_1's binary_logloss: 0.140963	valid_1's auc: 0.837295
[20]	valid_0's binary_logloss: 0.12855	valid_0's auc: 0.863276	valid_1's binary_logloss: 0.140751	valid_1's auc: 0.837772
[21]	valid_0's binary_logloss: 0.128139	valid_0's auc: 0.864197	valid_1's binary_logloss: 0.140652	valid_1's auc: 0.837784
[22]	valid_0's binary_logloss: 0.12775	valid_0's auc: 0.865145	valid_1's binary_logloss: 0.140483	valid_1's auc: 0.837974
[23]	valid_0's binary_logloss: 0.127368	valid_0's auc: 0.865962	valid_1's binary_logloss: 0.140367	valid_1's auc: 0.837557
[24]	valid_0's binary_logloss: 0.127008	valid_0's auc: 0.866988	valid_1's binary_logloss: 0.140316	valid_1's auc: 0.837021
[25]	valid_0's binary_logloss: 0.12663	valid_0's auc: 0.868263	valid_1's binary_logloss: 0.140197	valid_1's auc: 0.837265
[26]	valid_0's binary_logloss: 0.126317	valid_0's auc: 0.868968	valid_1's binary_logloss: 0.140127	valid_1's auc: 0.836987
[27]	valid_0's binary_logloss: 0.126031	valid_0's auc: 0.869684	valid_1's binary_logloss: 0.140054	valid_1's auc: 0.837221
[28]	valid_0's binary_logloss: 0.125747	valid_0's auc: 0.870355	valid_1's binary_logloss: 0.13997	valid_1's auc: 0.837362
[29]	valid_0's binary_logloss: 0.12547	valid_0's auc: 0.871186	valid_1's binary_logloss: 0.139918	valid_1's auc: 0.837231
[30]	valid_0's binary_logloss: 0.125224	valid_0's auc: 0.871902	valid_1's binary_logloss: 0.139873	valid_1's auc: 0.837133
[31]	valid_0's binary_logloss: 0.124989	valid_0's auc: 0.872311	valid_1's binary_logloss: 0.139847	valid_1's auc: 0.83717
[32]	valid_0's binary_logloss: 0.12477	valid_0's auc: 0.872917	valid_1's binary_logloss: 0.139784	valid_1's auc: 0.837439
[33]	valid_0's binary_logloss: 0.12454	valid_0's auc: 0.873431	valid_1's binary_logloss: 0.139749	valid_1's auc: 0.837452
[34]	valid_0's binary_logloss: 0.124274	valid_0's auc: 0.874128	valid_1's binary_logloss: 0.139762	valid_1's auc: 0.837524
[35]	valid_0's binary_logloss: 0.12402	valid_0's auc: 0.874804	valid_1's binary_logloss: 0.139751	valid_1's auc: 0.837469
[36]	valid_0's binary_logloss: 0.123792	valid_0's auc: 0.875352	valid_1's binary_logloss: 0.139769	valid_1's auc: 0.83736
[37]	valid_0's binary_logloss: 0.123559	valid_0's auc: 0.87599	valid_1's binary_logloss: 0.139757	valid_1's auc: 0.837238
[38]	valid_0's binary_logloss: 0.123367	valid_0's auc: 0.876681	valid_1's binary_logloss: 0.139742	valid_1's auc: 0.837375
[39]	valid_0's binary_logloss: 0.123176	valid_0's auc: 0.877229	valid_1's binary_logloss: 0.139777	valid_1's auc: 0.837053
[40]	valid_0's binary_logloss: 0.122931	valid_0's auc: 0.877783	valid_1's binary_logloss: 0.139728	valid_1's auc: 0.837245
[41]	valid_0's binary_logloss: 0.122698	valid_0's auc: 0.878412	valid_1's binary_logloss: 0.139754	valid_1's auc: 0.837189
[42]	valid_0's binary_logloss: 0.122487	valid_0's auc: 0.879389	valid_1's binary_logloss: 0.139729	valid_1's auc: 0.837385
[43]	valid_0's binary_logloss: 0.122278	valid_0's auc: 0.879887	valid_1's binary_logloss: 0.139768	valid_1's auc: 0.83703
[44]	valid_0's binary_logloss: 0.12209	valid_0's auc: 0.880265	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.837043
[45]	valid_0's binary_logloss: 0.121908	valid_0's auc: 0.880695	valid_1's binary_logloss: 0.139671	valid_1's auc: 0.837265
[46]	valid_0's binary_logloss: 0.121712	valid_0's auc: 0.881124	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.837228
[47]	valid_0's binary_logloss: 0.121548	valid_0's auc: 0.881391	valid_1's binary_logloss: 0.139699	valid_1's auc: 0.837146
[48]	valid_0's binary_logloss: 0.121346	valid_0's auc: 0.881926	valid_1's binary_logloss: 0.139641	valid_1's auc: 0.837387
[49]	valid_0's binary_logloss: 0.121183	valid_0's auc: 0.882497	valid_1's binary_logloss: 0.13965	valid_1's auc: 0.837464
[50]	valid_0's binary_logloss: 0.121013	valid_0's auc: 0.882962	valid_1's binary_logloss: 0.139684	valid_1's auc: 0.837347
[51]	valid_0's binary_logloss: 0.120868	valid_0's auc: 0.883328	valid_1's binary_logloss: 0.139662	valid_1's auc: 0.837533
[52]	valid_0's binary_logloss: 0.12066	valid_0's auc: 0.883845	valid_1's binary_logloss: 0.139589	valid_1's auc: 0.838071
[53]	valid_0's binary_logloss: 0.120503	valid_0's auc: 0.884228	valid_1's binary_logloss: 0.139593	valid_1's auc: 0.837994
[54]	valid_0's binary_logloss: 0.120376	valid_0's auc: 0.884403	valid_1's binary_logloss: 0.139642	valid_1's auc: 0.837897
[55]	valid_0's binary_logloss: 0.120214	valid_0's auc: 0.884574	valid_1's binary_logloss: 0.139613	valid_1's auc: 0.838054
[56]	valid_0's binary_logloss: 0.120016	valid_0's auc: 0.885034	valid_1's binary_logloss: 0.139564	valid_1's auc: 0.838201
[57]	valid_0's binary_logloss: 0.119848	valid_0's auc: 0.885329	valid_1's binary_logloss: 0.139573	valid_1's auc: 0.838183
[58]	valid_0's binary_logloss: 0.119733	valid_0's auc: 0.885429	valid_1's binary_logloss: 0.139566	valid_1's auc: 0.838352
[59]	valid_0's binary_logloss: 0.119583	valid_0's auc: 0.885751	valid_1's binary_logloss: 0.139641	valid_1's auc: 0.838177
[60]	valid_0's binary_logloss: 0.119461	valid_0's auc: 0.885952	valid_1's binary_logloss: 0.139615	valid_1's auc: 0.838373
[61]	valid_0's binary_logloss: 0.119357	valid_0's auc: 0.886123	valid_1's binary_logloss: 0.139644	valid_1's auc: 0.838135
[62]	valid_0's binary_logloss: 0.119218	valid_0's auc: 0.886592	valid_1's binary_logloss: 0.139648	valid_1's auc: 0.83826
[63]	valid_0's binary_logloss: 0.11911	valid_0's auc: 0.886712	valid_1's binary_logloss: 0.139729	valid_1's auc: 0.838084
[64]	valid_0's binary_logloss: 0.119003	valid_0's auc: 0.886807	valid_1's binary_logloss: 0.139706	valid_1's auc: 0.838391
[65]	valid_0's binary_logloss: 0.11888	valid_0's auc: 0.887021	valid_1's binary_logloss: 0.13972	valid_1's auc: 0.838343
[66]	valid_0's binary_logloss: 0.118728	valid_0's auc: 0.88734	valid_1's binary_logloss: 0.139788	valid_1's auc: 0.838004
[67]	valid_0's binary_logloss: 0.118646	valid_0's auc: 0.887341	valid_1's binary_logloss: 0.139839	valid_1's auc: 0.837935
[68]	valid_0's binary_logloss: 0.118505	valid_0's auc: 0.887601	valid_1's binary_logloss: 0.139839	valid_1's auc: 0.837981
[69]	valid_0's binary_logloss: 0.11833	valid_0's auc: 0.887954	valid_1's binary_logloss: 0.139867	valid_1's auc: 0.83787
[70]	valid_0's binary_logloss: 0.118209	valid_0's auc: 0.888114	valid_1's binary_logloss: 0.139919	valid_1's auc: 0.837718
[71]	valid_0's binary_logloss: 0.118049	valid_0's auc: 0.888481	valid_1's binary_logloss: 0.139893	valid_1's auc: 0.837821
[72]	valid_0's binary_logloss: 0.117903	valid_0's auc: 0.888835	valid_1's binary_logloss: 0.139952	valid_1's auc: 0.837731
[73]	valid_0's binary_logloss: 0.117758	valid_0's auc: 0.889134	valid_1's binary_logloss: 0.139962	valid_1's auc: 0.837899
[74]	valid_0's binary_logloss: 0.117691	valid_0's auc: 0.889144	valid_1's binary_logloss: 0.13998	valid_1's auc: 0.83792
[75]	valid_0's binary_logloss: 0.117578	valid_0's auc: 0.889275	valid_1's binary_logloss: 0.139953	valid_1's auc: 0.838045
[76]	valid_0's binary_logloss: 0.117479	valid_0's auc: 0.88948	valid_1's binary_logloss: 0.140036	valid_1's auc: 0.837718
[77]	valid_0's binary_logloss: 0.117401	valid_0's auc: 0.889549	valid_1's binary_logloss: 0.140101	valid_1's auc: 0.837554
[78]	valid_0's binary_logloss: 0.117323	valid_0's auc: 0.889594	valid_1's binary_logloss: 0.140162	valid_1's auc: 0.837358
[79]	valid_0's binary_logloss: 0.117242	valid_0's auc: 0.889725	valid_1's binary_logloss: 0.140191	valid_1's auc: 0.837296
[80]	valid_0's binary_logloss: 0.117092	valid_0's auc: 0.890095	valid_1's binary_logloss: 0.140182	valid_1's auc: 0.837436
[81]	valid_0's binary_logloss: 0.116991	valid_0's auc: 0.890237	valid_1's binary_logloss: 0.140185	valid_1's auc: 0.837617
[82]	valid_0's binary_logloss: 0.116893	valid_0's auc: 0.89035	valid_1's binary_logloss: 0.140191	valid_1's auc: 0.837676
[83]	valid_0's binary_logloss: 0.116801	valid_0's auc: 0.890464	valid_1's binary_logloss: 0.140249	valid_1's auc: 0.837537
[84]	valid_0's binary_logloss: 0.116619	valid_0's auc: 0.890869	valid_1's binary_logloss: 0.140263	valid_1's auc: 0.837565
[85]	valid_0's binary_logloss: 0.116509	valid_0's auc: 0.891174	valid_1's binary_logloss: 0.140345	valid_1's auc: 0.837241
[86]	valid_0's binary_logloss: 0.116424	valid_0's auc: 0.891255	valid_1's binary_logloss: 0.140382	valid_1's auc: 0.837141
Early stopping, best iteration is:
[56]	valid_0's binary_logloss: 0.120016	valid_0's auc: 0.885034	valid_1's binary_logloss: 0.139564	valid_1's auc: 0.838201
[1]	valid_0's binary_logloss: 0.155721	valid_0's auc: 0.835412	valid_1's binary_logloss: 0.164844	valid_1's auc: 0.81973
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150324	valid_0's auc: 0.841215	valid_1's binary_logloss: 0.159859	valid_1's auc: 0.823632
[3]	valid_0's binary_logloss: 0.146303	valid_0's auc: 0.846402	valid_1's binary_logloss: 0.156265	valid_1's auc: 0.824432
[4]	valid_0's binary_logloss: 0.143141	valid_0's auc: 0.851123	valid_1's binary_logloss: 0.153379	valid_1's auc: 0.830341
[5]	valid_0's binary_logloss: 0.140571	valid_0's auc: 0.853991	valid_1's binary_logloss: 0.151129	valid_1's auc: 0.831329
[6]	valid_0's binary_logloss: 0.138389	valid_0's auc: 0.856674	valid_1's binary_logloss: 0.149272	valid_1's auc: 0.833102
[7]	valid_0's binary_logloss: 0.136551	valid_0's auc: 0.858444	valid_1's binary_logloss: 0.14779	valid_1's auc: 0.833757
[8]	valid_0's binary_logloss: 0.135038	valid_0's auc: 0.859496	valid_1's binary_logloss: 0.146518	valid_1's auc: 0.834435
[9]	valid_0's binary_logloss: 0.133585	valid_0's auc: 0.861389	valid_1's binary_logloss: 0.145534	valid_1's auc: 0.834629
[10]	valid_0's binary_logloss: 0.132396	valid_0's auc: 0.863665	valid_1's binary_logloss: 0.144698	valid_1's auc: 0.834967
[11]	valid_0's binary_logloss: 0.13134	valid_0's auc: 0.865337	valid_1's binary_logloss: 0.144026	valid_1's auc: 0.835265
[12]	valid_0's binary_logloss: 0.130312	valid_0's auc: 0.86681	valid_1's binary_logloss: 0.143395	valid_1's auc: 0.835596
[13]	valid_0's binary_logloss: 0.129392	valid_0's auc: 0.868736	valid_1's binary_logloss: 0.142859	valid_1's auc: 0.835221
[14]	valid_0's binary_logloss: 0.128555	valid_0's auc: 0.870248	valid_1's binary_logloss: 0.142419	valid_1's auc: 0.835178
[15]	valid_0's binary_logloss: 0.127833	valid_0's auc: 0.87138	valid_1's binary_logloss: 0.14216	valid_1's auc: 0.834834
[16]	valid_0's binary_logloss: 0.127151	valid_0's auc: 0.872373	valid_1's binary_logloss: 0.141863	valid_1's auc: 0.834648
[17]	valid_0's binary_logloss: 0.126561	valid_0's auc: 0.873016	valid_1's binary_logloss: 0.141838	valid_1's auc: 0.83334
[18]	valid_0's binary_logloss: 0.125944	valid_0's auc: 0.874082	valid_1's binary_logloss: 0.141517	valid_1's auc: 0.833668
[19]	valid_0's binary_logloss: 0.125371	valid_0's auc: 0.875136	valid_1's binary_logloss: 0.141507	valid_1's auc: 0.832742
[20]	valid_0's binary_logloss: 0.124814	valid_0's auc: 0.876197	valid_1's binary_logloss: 0.141376	valid_1's auc: 0.832569
[21]	valid_0's binary_logloss: 0.124265	valid_0's auc: 0.877286	valid_1's binary_logloss: 0.141369	valid_1's auc: 0.831531
[22]	valid_0's binary_logloss: 0.12376	valid_0's auc: 0.878351	valid_1's binary_logloss: 0.141291	valid_1's auc: 0.831493
[23]	valid_0's binary_logloss: 0.123252	valid_0's auc: 0.87915	valid_1's binary_logloss: 0.141173	valid_1's auc: 0.831944
[24]	valid_0's binary_logloss: 0.122817	valid_0's auc: 0.88009	valid_1's binary_logloss: 0.141183	valid_1's auc: 0.831531
[25]	valid_0's binary_logloss: 0.12235	valid_0's auc: 0.881183	valid_1's binary_logloss: 0.141142	valid_1's auc: 0.831519
[26]	valid_0's binary_logloss: 0.121911	valid_0's auc: 0.882242	valid_1's binary_logloss: 0.141125	valid_1's auc: 0.83122
[27]	valid_0's binary_logloss: 0.121503	valid_0's auc: 0.882894	valid_1's binary_logloss: 0.141169	valid_1's auc: 0.830821
[28]	valid_0's binary_logloss: 0.121051	valid_0's auc: 0.883863	valid_1's binary_logloss: 0.141164	valid_1's auc: 0.830774
[29]	valid_0's binary_logloss: 0.12066	valid_0's auc: 0.884664	valid_1's binary_logloss: 0.141239	valid_1's auc: 0.830255
[30]	valid_0's binary_logloss: 0.120322	valid_0's auc: 0.885346	valid_1's binary_logloss: 0.141355	valid_1's auc: 0.829487
[31]	valid_0's binary_logloss: 0.119914	valid_0's auc: 0.88669	valid_1's binary_logloss: 0.141339	valid_1's auc: 0.829648
[32]	valid_0's binary_logloss: 0.119542	valid_0's auc: 0.887524	valid_1's binary_logloss: 0.14135	valid_1's auc: 0.829315
[33]	valid_0's binary_logloss: 0.119183	valid_0's auc: 0.888251	valid_1's binary_logloss: 0.141344	valid_1's auc: 0.82931
[34]	valid_0's binary_logloss: 0.118927	valid_0's auc: 0.888706	valid_1's binary_logloss: 0.141416	valid_1's auc: 0.829105
[35]	valid_0's binary_logloss: 0.118593	valid_0's auc: 0.889307	valid_1's binary_logloss: 0.141513	valid_1's auc: 0.828734
[36]	valid_0's binary_logloss: 0.11827	valid_0's auc: 0.890033	valid_1's binary_logloss: 0.141387	valid_1's auc: 0.829267
[37]	valid_0's binary_logloss: 0.11791	valid_0's auc: 0.890794	valid_1's binary_logloss: 0.141414	valid_1's auc: 0.829028
[38]	valid_0's binary_logloss: 0.11759	valid_0's auc: 0.891883	valid_1's binary_logloss: 0.141499	valid_1's auc: 0.828809
[39]	valid_0's binary_logloss: 0.117294	valid_0's auc: 0.892363	valid_1's binary_logloss: 0.141556	valid_1's auc: 0.828552
[40]	valid_0's binary_logloss: 0.117026	valid_0's auc: 0.89279	valid_1's binary_logloss: 0.141604	valid_1's auc: 0.828434
[41]	valid_0's binary_logloss: 0.116765	valid_0's auc: 0.893455	valid_1's binary_logloss: 0.141573	valid_1's auc: 0.828598
[42]	valid_0's binary_logloss: 0.116515	valid_0's auc: 0.893797	valid_1's binary_logloss: 0.1416	valid_1's auc: 0.828463
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.130312	valid_0's auc: 0.86681	valid_1's binary_logloss: 0.143395	valid_1's auc: 0.835596
[1]	valid_0's binary_logloss: 0.155928	valid_0's auc: 0.830474	valid_1's binary_logloss: 0.164928	valid_1's auc: 0.817343
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150276	valid_0's auc: 0.842991	valid_1's binary_logloss: 0.159411	valid_1's auc: 0.827907
[3]	valid_0's binary_logloss: 0.146251	valid_0's auc: 0.851825	valid_1's binary_logloss: 0.155739	valid_1's auc: 0.832413
[4]	valid_0's binary_logloss: 0.143091	valid_0's auc: 0.854455	valid_1's binary_logloss: 0.15282	valid_1's auc: 0.833987
[5]	valid_0's binary_logloss: 0.140521	valid_0's auc: 0.857038	valid_1's binary_logloss: 0.150456	valid_1's auc: 0.836024
[6]	valid_0's binary_logloss: 0.138303	valid_0's auc: 0.859784	valid_1's binary_logloss: 0.148558	valid_1's auc: 0.836565
[7]	valid_0's binary_logloss: 0.13638	valid_0's auc: 0.861991	valid_1's binary_logloss: 0.147071	valid_1's auc: 0.837355
[8]	valid_0's binary_logloss: 0.134702	valid_0's auc: 0.863742	valid_1's binary_logloss: 0.145789	valid_1's auc: 0.837366
[9]	valid_0's binary_logloss: 0.1333	valid_0's auc: 0.865288	valid_1's binary_logloss: 0.144676	valid_1's auc: 0.838092
[10]	valid_0's binary_logloss: 0.132065	valid_0's auc: 0.866558	valid_1's binary_logloss: 0.143753	valid_1's auc: 0.838732
[11]	valid_0's binary_logloss: 0.131005	valid_0's auc: 0.867378	valid_1's binary_logloss: 0.142985	valid_1's auc: 0.838939
[12]	valid_0's binary_logloss: 0.130046	valid_0's auc: 0.868402	valid_1's binary_logloss: 0.142418	valid_1's auc: 0.837922
[13]	valid_0's binary_logloss: 0.12914	valid_0's auc: 0.869713	valid_1's binary_logloss: 0.141868	valid_1's auc: 0.838282
[14]	valid_0's binary_logloss: 0.128307	valid_0's auc: 0.870702	valid_1's binary_logloss: 0.141374	valid_1's auc: 0.838019
[15]	valid_0's binary_logloss: 0.127523	valid_0's auc: 0.871975	valid_1's binary_logloss: 0.140933	valid_1's auc: 0.83802
[16]	valid_0's binary_logloss: 0.126793	valid_0's auc: 0.873071	valid_1's binary_logloss: 0.140591	valid_1's auc: 0.838163
[17]	valid_0's binary_logloss: 0.126108	valid_0's auc: 0.874334	valid_1's binary_logloss: 0.140362	valid_1's auc: 0.837716
[18]	valid_0's binary_logloss: 0.125531	valid_0's auc: 0.875627	valid_1's binary_logloss: 0.140249	valid_1's auc: 0.836977
[19]	valid_0's binary_logloss: 0.124919	valid_0's auc: 0.876957	valid_1's binary_logloss: 0.140038	valid_1's auc: 0.837445
[20]	valid_0's binary_logloss: 0.124384	valid_0's auc: 0.877892	valid_1's binary_logloss: 0.139918	valid_1's auc: 0.837849
[21]	valid_0's binary_logloss: 0.12384	valid_0's auc: 0.878874	valid_1's binary_logloss: 0.139882	valid_1's auc: 0.837238
[22]	valid_0's binary_logloss: 0.123266	valid_0's auc: 0.880326	valid_1's binary_logloss: 0.139792	valid_1's auc: 0.836997
[23]	valid_0's binary_logloss: 0.122729	valid_0's auc: 0.881582	valid_1's binary_logloss: 0.139713	valid_1's auc: 0.83712
[24]	valid_0's binary_logloss: 0.122317	valid_0's auc: 0.882456	valid_1's binary_logloss: 0.139557	valid_1's auc: 0.837621
[25]	valid_0's binary_logloss: 0.121815	valid_0's auc: 0.883646	valid_1's binary_logloss: 0.139517	valid_1's auc: 0.837461
[26]	valid_0's binary_logloss: 0.12134	valid_0's auc: 0.884752	valid_1's binary_logloss: 0.139402	valid_1's auc: 0.837924
[27]	valid_0's binary_logloss: 0.120926	valid_0's auc: 0.885706	valid_1's binary_logloss: 0.139415	valid_1's auc: 0.837521
[28]	valid_0's binary_logloss: 0.12049	valid_0's auc: 0.886476	valid_1's binary_logloss: 0.139392	valid_1's auc: 0.837391
[29]	valid_0's binary_logloss: 0.120092	valid_0's auc: 0.887401	valid_1's binary_logloss: 0.139389	valid_1's auc: 0.837142
[30]	valid_0's binary_logloss: 0.119653	valid_0's auc: 0.88847	valid_1's binary_logloss: 0.139427	valid_1's auc: 0.837007
[31]	valid_0's binary_logloss: 0.119235	valid_0's auc: 0.889406	valid_1's binary_logloss: 0.13934	valid_1's auc: 0.837386
[32]	valid_0's binary_logloss: 0.118854	valid_0's auc: 0.890464	valid_1's binary_logloss: 0.139395	valid_1's auc: 0.836872
[33]	valid_0's binary_logloss: 0.118486	valid_0's auc: 0.891323	valid_1's binary_logloss: 0.139445	valid_1's auc: 0.836772
[34]	valid_0's binary_logloss: 0.118123	valid_0's auc: 0.892149	valid_1's binary_logloss: 0.139504	valid_1's auc: 0.836389
[35]	valid_0's binary_logloss: 0.117793	valid_0's auc: 0.892998	valid_1's binary_logloss: 0.139533	valid_1's auc: 0.836255
[36]	valid_0's binary_logloss: 0.117478	valid_0's auc: 0.89356	valid_1's binary_logloss: 0.139523	valid_1's auc: 0.836322
[37]	valid_0's binary_logloss: 0.117177	valid_0's auc: 0.894086	valid_1's binary_logloss: 0.13956	valid_1's auc: 0.836152
[38]	valid_0's binary_logloss: 0.116796	valid_0's auc: 0.894901	valid_1's binary_logloss: 0.139585	valid_1's auc: 0.836268
[39]	valid_0's binary_logloss: 0.116504	valid_0's auc: 0.895733	valid_1's binary_logloss: 0.139544	valid_1's auc: 0.836498
[40]	valid_0's binary_logloss: 0.116196	valid_0's auc: 0.896306	valid_1's binary_logloss: 0.139553	valid_1's auc: 0.836675
[41]	valid_0's binary_logloss: 0.115849	valid_0's auc: 0.897067	valid_1's binary_logloss: 0.139607	valid_1's auc: 0.83661
Early stopping, best iteration is:
[11]	valid_0's binary_logloss: 0.131005	valid_0's auc: 0.867378	valid_1's binary_logloss: 0.142985	valid_1's auc: 0.838939
[1]	valid_0's binary_logloss: 0.15607	valid_0's auc: 0.834724	valid_1's binary_logloss: 0.165104	valid_1's auc: 0.822983
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150505	valid_0's auc: 0.842399	valid_1's binary_logloss: 0.159789	valid_1's auc: 0.82874
[3]	valid_0's binary_logloss: 0.146325	valid_0's auc: 0.847465	valid_1's binary_logloss: 0.155994	valid_1's auc: 0.830964
[4]	valid_0's binary_logloss: 0.14313	valid_0's auc: 0.850024	valid_1's binary_logloss: 0.153168	valid_1's auc: 0.831698
[5]	valid_0's binary_logloss: 0.140492	valid_0's auc: 0.853487	valid_1's binary_logloss: 0.150751	valid_1's auc: 0.834088
[6]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.855865	valid_1's binary_logloss: 0.148857	valid_1's auc: 0.834424
[7]	valid_0's binary_logloss: 0.136482	valid_0's auc: 0.857298	valid_1's binary_logloss: 0.147407	valid_1's auc: 0.835442
[8]	valid_0's binary_logloss: 0.134832	valid_0's auc: 0.858957	valid_1's binary_logloss: 0.146173	valid_1's auc: 0.835673
[9]	valid_0's binary_logloss: 0.133462	valid_0's auc: 0.861749	valid_1's binary_logloss: 0.145247	valid_1's auc: 0.835295
[10]	valid_0's binary_logloss: 0.132297	valid_0's auc: 0.863187	valid_1's binary_logloss: 0.144397	valid_1's auc: 0.835558
[11]	valid_0's binary_logloss: 0.131209	valid_0's auc: 0.86518	valid_1's binary_logloss: 0.143714	valid_1's auc: 0.835465
[12]	valid_0's binary_logloss: 0.130224	valid_0's auc: 0.866937	valid_1's binary_logloss: 0.143043	valid_1's auc: 0.835379
[13]	valid_0's binary_logloss: 0.129241	valid_0's auc: 0.869703	valid_1's binary_logloss: 0.142451	valid_1's auc: 0.836269
[14]	valid_0's binary_logloss: 0.128427	valid_0's auc: 0.870923	valid_1's binary_logloss: 0.142023	valid_1's auc: 0.836369
[15]	valid_0's binary_logloss: 0.127649	valid_0's auc: 0.872259	valid_1's binary_logloss: 0.141652	valid_1's auc: 0.836264
[16]	valid_0's binary_logloss: 0.126903	valid_0's auc: 0.873489	valid_1's binary_logloss: 0.141407	valid_1's auc: 0.836069
[17]	valid_0's binary_logloss: 0.126262	valid_0's auc: 0.874492	valid_1's binary_logloss: 0.141126	valid_1's auc: 0.836201
[18]	valid_0's binary_logloss: 0.125627	valid_0's auc: 0.87595	valid_1's binary_logloss: 0.140886	valid_1's auc: 0.83635
[19]	valid_0's binary_logloss: 0.125013	valid_0's auc: 0.877131	valid_1's binary_logloss: 0.140739	valid_1's auc: 0.836076
[20]	valid_0's binary_logloss: 0.124466	valid_0's auc: 0.878085	valid_1's binary_logloss: 0.140566	valid_1's auc: 0.83617
[21]	valid_0's binary_logloss: 0.123852	valid_0's auc: 0.879486	valid_1's binary_logloss: 0.140435	valid_1's auc: 0.836204
[22]	valid_0's binary_logloss: 0.123297	valid_0's auc: 0.880587	valid_1's binary_logloss: 0.140314	valid_1's auc: 0.836447
[23]	valid_0's binary_logloss: 0.122794	valid_0's auc: 0.881726	valid_1's binary_logloss: 0.140303	valid_1's auc: 0.836098
[24]	valid_0's binary_logloss: 0.122314	valid_0's auc: 0.882711	valid_1's binary_logloss: 0.140219	valid_1's auc: 0.83633
[25]	valid_0's binary_logloss: 0.121852	valid_0's auc: 0.883523	valid_1's binary_logloss: 0.140159	valid_1's auc: 0.836558
[26]	valid_0's binary_logloss: 0.121425	valid_0's auc: 0.88437	valid_1's binary_logloss: 0.140016	valid_1's auc: 0.83683
[27]	valid_0's binary_logloss: 0.120914	valid_0's auc: 0.885636	valid_1's binary_logloss: 0.13996	valid_1's auc: 0.836819
[28]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.886325	valid_1's binary_logloss: 0.139864	valid_1's auc: 0.837376
[29]	valid_0's binary_logloss: 0.120163	valid_0's auc: 0.887055	valid_1's binary_logloss: 0.139938	valid_1's auc: 0.836929
[30]	valid_0's binary_logloss: 0.119761	valid_0's auc: 0.887923	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.836813
[31]	valid_0's binary_logloss: 0.11938	valid_0's auc: 0.888783	valid_1's binary_logloss: 0.139954	valid_1's auc: 0.836207
[32]	valid_0's binary_logloss: 0.118999	valid_0's auc: 0.889881	valid_1's binary_logloss: 0.139895	valid_1's auc: 0.836409
[33]	valid_0's binary_logloss: 0.118666	valid_0's auc: 0.890577	valid_1's binary_logloss: 0.139943	valid_1's auc: 0.836063
[34]	valid_0's binary_logloss: 0.118351	valid_0's auc: 0.891155	valid_1's binary_logloss: 0.139964	valid_1's auc: 0.836137
[35]	valid_0's binary_logloss: 0.118001	valid_0's auc: 0.891785	valid_1's binary_logloss: 0.139945	valid_1's auc: 0.836228
[36]	valid_0's binary_logloss: 0.117642	valid_0's auc: 0.89242	valid_1's binary_logloss: 0.139981	valid_1's auc: 0.836019
[37]	valid_0's binary_logloss: 0.117331	valid_0's auc: 0.893202	valid_1's binary_logloss: 0.140014	valid_1's auc: 0.835858
[38]	valid_0's binary_logloss: 0.117028	valid_0's auc: 0.893881	valid_1's binary_logloss: 0.140116	valid_1's auc: 0.835594
[39]	valid_0's binary_logloss: 0.11671	valid_0's auc: 0.89439	valid_1's binary_logloss: 0.140166	valid_1's auc: 0.8355
[40]	valid_0's binary_logloss: 0.116439	valid_0's auc: 0.894767	valid_1's binary_logloss: 0.140175	valid_1's auc: 0.835564
[41]	valid_0's binary_logloss: 0.116161	valid_0's auc: 0.895261	valid_1's binary_logloss: 0.140228	valid_1's auc: 0.835399
[42]	valid_0's binary_logloss: 0.115888	valid_0's auc: 0.895782	valid_1's binary_logloss: 0.14032	valid_1's auc: 0.835369
[43]	valid_0's binary_logloss: 0.115655	valid_0's auc: 0.895994	valid_1's binary_logloss: 0.140379	valid_1's auc: 0.835382
[44]	valid_0's binary_logloss: 0.115426	valid_0's auc: 0.896287	valid_1's binary_logloss: 0.140406	valid_1's auc: 0.835169
[45]	valid_0's binary_logloss: 0.115148	valid_0's auc: 0.896767	valid_1's binary_logloss: 0.140418	valid_1's auc: 0.835223
[46]	valid_0's binary_logloss: 0.114846	valid_0's auc: 0.897406	valid_1's binary_logloss: 0.140402	valid_1's auc: 0.835554
[47]	valid_0's binary_logloss: 0.114594	valid_0's auc: 0.897922	valid_1's binary_logloss: 0.140445	valid_1's auc: 0.835407
[48]	valid_0's binary_logloss: 0.114317	valid_0's auc: 0.898413	valid_1's binary_logloss: 0.140451	valid_1's auc: 0.835472
[49]	valid_0's binary_logloss: 0.114115	valid_0's auc: 0.89881	valid_1's binary_logloss: 0.14045	valid_1's auc: 0.835652
[50]	valid_0's binary_logloss: 0.113872	valid_0's auc: 0.89913	valid_1's binary_logloss: 0.1405	valid_1's auc: 0.835727
[51]	valid_0's binary_logloss: 0.113635	valid_0's auc: 0.899546	valid_1's binary_logloss: 0.140435	valid_1's auc: 0.836189
[52]	valid_0's binary_logloss: 0.113446	valid_0's auc: 0.899796	valid_1's binary_logloss: 0.140412	valid_1's auc: 0.836528
[53]	valid_0's binary_logloss: 0.113287	valid_0's auc: 0.899848	valid_1's binary_logloss: 0.140511	valid_1's auc: 0.836191
[54]	valid_0's binary_logloss: 0.113006	valid_0's auc: 0.900303	valid_1's binary_logloss: 0.140619	valid_1's auc: 0.835867
[55]	valid_0's binary_logloss: 0.112738	valid_0's auc: 0.900788	valid_1's binary_logloss: 0.140716	valid_1's auc: 0.835597
[56]	valid_0's binary_logloss: 0.112563	valid_0's auc: 0.900867	valid_1's binary_logloss: 0.140731	valid_1's auc: 0.835775
[57]	valid_0's binary_logloss: 0.112423	valid_0's auc: 0.900882	valid_1's binary_logloss: 0.140747	valid_1's auc: 0.835795
[58]	valid_0's binary_logloss: 0.112179	valid_0's auc: 0.901235	valid_1's binary_logloss: 0.140809	valid_1's auc: 0.835782
Early stopping, best iteration is:
[28]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.886325	valid_1's binary_logloss: 0.139864	valid_1's auc: 0.837376
[1]	valid_0's binary_logloss: 0.155721	valid_0's auc: 0.835412	valid_1's binary_logloss: 0.164844	valid_1's auc: 0.81973
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150324	valid_0's auc: 0.841215	valid_1's binary_logloss: 0.159859	valid_1's auc: 0.823632
[3]	valid_0's binary_logloss: 0.146303	valid_0's auc: 0.846402	valid_1's binary_logloss: 0.156265	valid_1's auc: 0.824432
[4]	valid_0's binary_logloss: 0.143141	valid_0's auc: 0.851123	valid_1's binary_logloss: 0.153379	valid_1's auc: 0.830341
[5]	valid_0's binary_logloss: 0.140571	valid_0's auc: 0.853991	valid_1's binary_logloss: 0.151129	valid_1's auc: 0.831329
[6]	valid_0's binary_logloss: 0.138389	valid_0's auc: 0.856674	valid_1's binary_logloss: 0.149272	valid_1's auc: 0.833102
[7]	valid_0's binary_logloss: 0.136551	valid_0's auc: 0.858444	valid_1's binary_logloss: 0.14779	valid_1's auc: 0.833757
[8]	valid_0's binary_logloss: 0.135038	valid_0's auc: 0.859496	valid_1's binary_logloss: 0.146518	valid_1's auc: 0.834435
[9]	valid_0's binary_logloss: 0.133585	valid_0's auc: 0.861389	valid_1's binary_logloss: 0.145534	valid_1's auc: 0.834629
[10]	valid_0's binary_logloss: 0.132396	valid_0's auc: 0.863665	valid_1's binary_logloss: 0.144698	valid_1's auc: 0.834967
[11]	valid_0's binary_logloss: 0.13134	valid_0's auc: 0.865337	valid_1's binary_logloss: 0.144026	valid_1's auc: 0.835265
[12]	valid_0's binary_logloss: 0.130312	valid_0's auc: 0.86681	valid_1's binary_logloss: 0.143395	valid_1's auc: 0.835596
[13]	valid_0's binary_logloss: 0.129392	valid_0's auc: 0.868736	valid_1's binary_logloss: 0.142859	valid_1's auc: 0.835221
[14]	valid_0's binary_logloss: 0.128555	valid_0's auc: 0.870248	valid_1's binary_logloss: 0.142419	valid_1's auc: 0.835178
[15]	valid_0's binary_logloss: 0.127833	valid_0's auc: 0.87138	valid_1's binary_logloss: 0.14216	valid_1's auc: 0.834834
[16]	valid_0's binary_logloss: 0.127151	valid_0's auc: 0.872373	valid_1's binary_logloss: 0.141863	valid_1's auc: 0.834648
[17]	valid_0's binary_logloss: 0.126561	valid_0's auc: 0.873016	valid_1's binary_logloss: 0.141838	valid_1's auc: 0.83334
[18]	valid_0's binary_logloss: 0.125944	valid_0's auc: 0.874082	valid_1's binary_logloss: 0.141517	valid_1's auc: 0.833668
[19]	valid_0's binary_logloss: 0.125371	valid_0's auc: 0.875136	valid_1's binary_logloss: 0.141507	valid_1's auc: 0.832742
[20]	valid_0's binary_logloss: 0.124814	valid_0's auc: 0.876197	valid_1's binary_logloss: 0.141376	valid_1's auc: 0.832569
[21]	valid_0's binary_logloss: 0.124265	valid_0's auc: 0.877286	valid_1's binary_logloss: 0.141369	valid_1's auc: 0.831531
[22]	valid_0's binary_logloss: 0.12376	valid_0's auc: 0.878351	valid_1's binary_logloss: 0.141291	valid_1's auc: 0.831493
[23]	valid_0's binary_logloss: 0.123252	valid_0's auc: 0.87915	valid_1's binary_logloss: 0.141173	valid_1's auc: 0.831944
[24]	valid_0's binary_logloss: 0.122817	valid_0's auc: 0.88009	valid_1's binary_logloss: 0.141183	valid_1's auc: 0.831531
[25]	valid_0's binary_logloss: 0.12235	valid_0's auc: 0.881183	valid_1's binary_logloss: 0.141142	valid_1's auc: 0.831519
[26]	valid_0's binary_logloss: 0.121911	valid_0's auc: 0.882242	valid_1's binary_logloss: 0.141125	valid_1's auc: 0.83122
[27]	valid_0's binary_logloss: 0.121503	valid_0's auc: 0.882894	valid_1's binary_logloss: 0.141169	valid_1's auc: 0.830821
[28]	valid_0's binary_logloss: 0.121051	valid_0's auc: 0.883863	valid_1's binary_logloss: 0.141164	valid_1's auc: 0.830774
[29]	valid_0's binary_logloss: 0.12066	valid_0's auc: 0.884664	valid_1's binary_logloss: 0.141239	valid_1's auc: 0.830255
[30]	valid_0's binary_logloss: 0.120322	valid_0's auc: 0.885346	valid_1's binary_logloss: 0.141355	valid_1's auc: 0.829487
[31]	valid_0's binary_logloss: 0.119914	valid_0's auc: 0.88669	valid_1's binary_logloss: 0.141339	valid_1's auc: 0.829648
[32]	valid_0's binary_logloss: 0.119542	valid_0's auc: 0.887524	valid_1's binary_logloss: 0.14135	valid_1's auc: 0.829315
[33]	valid_0's binary_logloss: 0.119183	valid_0's auc: 0.888251	valid_1's binary_logloss: 0.141344	valid_1's auc: 0.82931
[34]	valid_0's binary_logloss: 0.118927	valid_0's auc: 0.888706	valid_1's binary_logloss: 0.141416	valid_1's auc: 0.829105
[35]	valid_0's binary_logloss: 0.118593	valid_0's auc: 0.889307	valid_1's binary_logloss: 0.141513	valid_1's auc: 0.828734
[36]	valid_0's binary_logloss: 0.11827	valid_0's auc: 0.890033	valid_1's binary_logloss: 0.141387	valid_1's auc: 0.829267
[37]	valid_0's binary_logloss: 0.11791	valid_0's auc: 0.890794	valid_1's binary_logloss: 0.141414	valid_1's auc: 0.829028
[38]	valid_0's binary_logloss: 0.11759	valid_0's auc: 0.891883	valid_1's binary_logloss: 0.141499	valid_1's auc: 0.828809
[39]	valid_0's binary_logloss: 0.117294	valid_0's auc: 0.892363	valid_1's binary_logloss: 0.141556	valid_1's auc: 0.828552
[40]	valid_0's binary_logloss: 0.117026	valid_0's auc: 0.89279	valid_1's binary_logloss: 0.141604	valid_1's auc: 0.828434
[41]	valid_0's binary_logloss: 0.116765	valid_0's auc: 0.893455	valid_1's binary_logloss: 0.141573	valid_1's auc: 0.828598
[42]	valid_0's binary_logloss: 0.116515	valid_0's auc: 0.893797	valid_1's binary_logloss: 0.1416	valid_1's auc: 0.828463
Early stopping, best iteration is:
[12]	valid_0's binary_logloss: 0.130312	valid_0's auc: 0.86681	valid_1's binary_logloss: 0.143395	valid_1's auc: 0.835596
[1]	valid_0's binary_logloss: 0.155928	valid_0's auc: 0.830474	valid_1's binary_logloss: 0.164928	valid_1's auc: 0.817343
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150276	valid_0's auc: 0.842991	valid_1's binary_logloss: 0.159411	valid_1's auc: 0.827907
[3]	valid_0's binary_logloss: 0.146251	valid_0's auc: 0.851825	valid_1's binary_logloss: 0.155739	valid_1's auc: 0.832413
[4]	valid_0's binary_logloss: 0.143091	valid_0's auc: 0.854455	valid_1's binary_logloss: 0.15282	valid_1's auc: 0.833987
[5]	valid_0's binary_logloss: 0.140521	valid_0's auc: 0.857038	valid_1's binary_logloss: 0.150456	valid_1's auc: 0.836024
[6]	valid_0's binary_logloss: 0.138303	valid_0's auc: 0.859784	valid_1's binary_logloss: 0.148558	valid_1's auc: 0.836565
[7]	valid_0's binary_logloss: 0.13638	valid_0's auc: 0.861991	valid_1's binary_logloss: 0.147071	valid_1's auc: 0.837355
[8]	valid_0's binary_logloss: 0.134702	valid_0's auc: 0.863742	valid_1's binary_logloss: 0.145789	valid_1's auc: 0.837366
[9]	valid_0's binary_logloss: 0.1333	valid_0's auc: 0.865288	valid_1's binary_logloss: 0.144676	valid_1's auc: 0.838092
[10]	valid_0's binary_logloss: 0.132065	valid_0's auc: 0.866558	valid_1's binary_logloss: 0.143753	valid_1's auc: 0.838732
[11]	valid_0's binary_logloss: 0.131005	valid_0's auc: 0.867378	valid_1's binary_logloss: 0.142985	valid_1's auc: 0.838939
[12]	valid_0's binary_logloss: 0.130046	valid_0's auc: 0.868402	valid_1's binary_logloss: 0.142418	valid_1's auc: 0.837922
[13]	valid_0's binary_logloss: 0.12914	valid_0's auc: 0.869713	valid_1's binary_logloss: 0.141868	valid_1's auc: 0.838282
[14]	valid_0's binary_logloss: 0.128307	valid_0's auc: 0.870702	valid_1's binary_logloss: 0.141374	valid_1's auc: 0.838019
[15]	valid_0's binary_logloss: 0.127523	valid_0's auc: 0.871975	valid_1's binary_logloss: 0.140933	valid_1's auc: 0.83802
[16]	valid_0's binary_logloss: 0.126793	valid_0's auc: 0.873071	valid_1's binary_logloss: 0.140591	valid_1's auc: 0.838163
[17]	valid_0's binary_logloss: 0.126108	valid_0's auc: 0.874334	valid_1's binary_logloss: 0.140362	valid_1's auc: 0.837716
[18]	valid_0's binary_logloss: 0.125531	valid_0's auc: 0.875627	valid_1's binary_logloss: 0.140249	valid_1's auc: 0.836977
[19]	valid_0's binary_logloss: 0.124919	valid_0's auc: 0.876957	valid_1's binary_logloss: 0.140038	valid_1's auc: 0.837445
[20]	valid_0's binary_logloss: 0.124384	valid_0's auc: 0.877892	valid_1's binary_logloss: 0.139918	valid_1's auc: 0.837849
[21]	valid_0's binary_logloss: 0.12384	valid_0's auc: 0.878874	valid_1's binary_logloss: 0.139882	valid_1's auc: 0.837238
[22]	valid_0's binary_logloss: 0.123266	valid_0's auc: 0.880326	valid_1's binary_logloss: 0.139792	valid_1's auc: 0.836997
[23]	valid_0's binary_logloss: 0.122729	valid_0's auc: 0.881582	valid_1's binary_logloss: 0.139713	valid_1's auc: 0.83712
[24]	valid_0's binary_logloss: 0.122317	valid_0's auc: 0.882456	valid_1's binary_logloss: 0.139557	valid_1's auc: 0.837621
[25]	valid_0's binary_logloss: 0.121815	valid_0's auc: 0.883646	valid_1's binary_logloss: 0.139517	valid_1's auc: 0.837461
[26]	valid_0's binary_logloss: 0.12134	valid_0's auc: 0.884752	valid_1's binary_logloss: 0.139402	valid_1's auc: 0.837924
[27]	valid_0's binary_logloss: 0.120926	valid_0's auc: 0.885706	valid_1's binary_logloss: 0.139415	valid_1's auc: 0.837521
[28]	valid_0's binary_logloss: 0.12049	valid_0's auc: 0.886476	valid_1's binary_logloss: 0.139392	valid_1's auc: 0.837391
[29]	valid_0's binary_logloss: 0.120092	valid_0's auc: 0.887401	valid_1's binary_logloss: 0.139389	valid_1's auc: 0.837142
[30]	valid_0's binary_logloss: 0.119653	valid_0's auc: 0.88847	valid_1's binary_logloss: 0.139427	valid_1's auc: 0.837007
[31]	valid_0's binary_logloss: 0.119235	valid_0's auc: 0.889406	valid_1's binary_logloss: 0.13934	valid_1's auc: 0.837386
[32]	valid_0's binary_logloss: 0.118854	valid_0's auc: 0.890464	valid_1's binary_logloss: 0.139395	valid_1's auc: 0.836872
[33]	valid_0's binary_logloss: 0.118486	valid_0's auc: 0.891323	valid_1's binary_logloss: 0.139445	valid_1's auc: 0.836772
[34]	valid_0's binary_logloss: 0.118123	valid_0's auc: 0.892149	valid_1's binary_logloss: 0.139504	valid_1's auc: 0.836389
[35]	valid_0's binary_logloss: 0.117793	valid_0's auc: 0.892998	valid_1's binary_logloss: 0.139533	valid_1's auc: 0.836255
[36]	valid_0's binary_logloss: 0.117478	valid_0's auc: 0.89356	valid_1's binary_logloss: 0.139523	valid_1's auc: 0.836322
[37]	valid_0's binary_logloss: 0.117177	valid_0's auc: 0.894086	valid_1's binary_logloss: 0.13956	valid_1's auc: 0.836152
[38]	valid_0's binary_logloss: 0.116796	valid_0's auc: 0.894901	valid_1's binary_logloss: 0.139585	valid_1's auc: 0.836268
[39]	valid_0's binary_logloss: 0.116504	valid_0's auc: 0.895733	valid_1's binary_logloss: 0.139544	valid_1's auc: 0.836498
[40]	valid_0's binary_logloss: 0.116196	valid_0's auc: 0.896306	valid_1's binary_logloss: 0.139553	valid_1's auc: 0.836675
[41]	valid_0's binary_logloss: 0.115849	valid_0's auc: 0.897067	valid_1's binary_logloss: 0.139607	valid_1's auc: 0.83661
Early stopping, best iteration is:
[11]	valid_0's binary_logloss: 0.131005	valid_0's auc: 0.867378	valid_1's binary_logloss: 0.142985	valid_1's auc: 0.838939
[1]	valid_0's binary_logloss: 0.15607	valid_0's auc: 0.834724	valid_1's binary_logloss: 0.165104	valid_1's auc: 0.822983
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150505	valid_0's auc: 0.842399	valid_1's binary_logloss: 0.159789	valid_1's auc: 0.82874
[3]	valid_0's binary_logloss: 0.146325	valid_0's auc: 0.847465	valid_1's binary_logloss: 0.155994	valid_1's auc: 0.830964
[4]	valid_0's binary_logloss: 0.14313	valid_0's auc: 0.850024	valid_1's binary_logloss: 0.153168	valid_1's auc: 0.831698
[5]	valid_0's binary_logloss: 0.140492	valid_0's auc: 0.853487	valid_1's binary_logloss: 0.150751	valid_1's auc: 0.834088
[6]	valid_0's binary_logloss: 0.138313	valid_0's auc: 0.855865	valid_1's binary_logloss: 0.148857	valid_1's auc: 0.834424
[7]	valid_0's binary_logloss: 0.136482	valid_0's auc: 0.857298	valid_1's binary_logloss: 0.147407	valid_1's auc: 0.835442
[8]	valid_0's binary_logloss: 0.134832	valid_0's auc: 0.858957	valid_1's binary_logloss: 0.146173	valid_1's auc: 0.835673
[9]	valid_0's binary_logloss: 0.133462	valid_0's auc: 0.861749	valid_1's binary_logloss: 0.145247	valid_1's auc: 0.835295
[10]	valid_0's binary_logloss: 0.132297	valid_0's auc: 0.863187	valid_1's binary_logloss: 0.144397	valid_1's auc: 0.835558
[11]	valid_0's binary_logloss: 0.131209	valid_0's auc: 0.86518	valid_1's binary_logloss: 0.143714	valid_1's auc: 0.835465
[12]	valid_0's binary_logloss: 0.130224	valid_0's auc: 0.866937	valid_1's binary_logloss: 0.143043	valid_1's auc: 0.835379
[13]	valid_0's binary_logloss: 0.129241	valid_0's auc: 0.869703	valid_1's binary_logloss: 0.142451	valid_1's auc: 0.836269
[14]	valid_0's binary_logloss: 0.128427	valid_0's auc: 0.870923	valid_1's binary_logloss: 0.142023	valid_1's auc: 0.836369
[15]	valid_0's binary_logloss: 0.127649	valid_0's auc: 0.872259	valid_1's binary_logloss: 0.141652	valid_1's auc: 0.836264
[16]	valid_0's binary_logloss: 0.126903	valid_0's auc: 0.873489	valid_1's binary_logloss: 0.141407	valid_1's auc: 0.836069
[17]	valid_0's binary_logloss: 0.126262	valid_0's auc: 0.874492	valid_1's binary_logloss: 0.141126	valid_1's auc: 0.836201
[18]	valid_0's binary_logloss: 0.125627	valid_0's auc: 0.87595	valid_1's binary_logloss: 0.140886	valid_1's auc: 0.83635
[19]	valid_0's binary_logloss: 0.125013	valid_0's auc: 0.877131	valid_1's binary_logloss: 0.140739	valid_1's auc: 0.836076
[20]	valid_0's binary_logloss: 0.124466	valid_0's auc: 0.878085	valid_1's binary_logloss: 0.140566	valid_1's auc: 0.83617
[21]	valid_0's binary_logloss: 0.123852	valid_0's auc: 0.879486	valid_1's binary_logloss: 0.140435	valid_1's auc: 0.836204
[22]	valid_0's binary_logloss: 0.123297	valid_0's auc: 0.880587	valid_1's binary_logloss: 0.140314	valid_1's auc: 0.836447
[23]	valid_0's binary_logloss: 0.122794	valid_0's auc: 0.881726	valid_1's binary_logloss: 0.140303	valid_1's auc: 0.836098
[24]	valid_0's binary_logloss: 0.122314	valid_0's auc: 0.882711	valid_1's binary_logloss: 0.140219	valid_1's auc: 0.83633
[25]	valid_0's binary_logloss: 0.121852	valid_0's auc: 0.883523	valid_1's binary_logloss: 0.140159	valid_1's auc: 0.836558
[26]	valid_0's binary_logloss: 0.121425	valid_0's auc: 0.88437	valid_1's binary_logloss: 0.140016	valid_1's auc: 0.83683
[27]	valid_0's binary_logloss: 0.120914	valid_0's auc: 0.885636	valid_1's binary_logloss: 0.13996	valid_1's auc: 0.836819
[28]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.886325	valid_1's binary_logloss: 0.139864	valid_1's auc: 0.837376
[29]	valid_0's binary_logloss: 0.120163	valid_0's auc: 0.887055	valid_1's binary_logloss: 0.139938	valid_1's auc: 0.836929
[30]	valid_0's binary_logloss: 0.119761	valid_0's auc: 0.887923	valid_1's binary_logloss: 0.13991	valid_1's auc: 0.836813
[31]	valid_0's binary_logloss: 0.11938	valid_0's auc: 0.888783	valid_1's binary_logloss: 0.139954	valid_1's auc: 0.836207
[32]	valid_0's binary_logloss: 0.118999	valid_0's auc: 0.889881	valid_1's binary_logloss: 0.139895	valid_1's auc: 0.836409
[33]	valid_0's binary_logloss: 0.118666	valid_0's auc: 0.890577	valid_1's binary_logloss: 0.139943	valid_1's auc: 0.836063
[34]	valid_0's binary_logloss: 0.118351	valid_0's auc: 0.891155	valid_1's binary_logloss: 0.139964	valid_1's auc: 0.836137
[35]	valid_0's binary_logloss: 0.118001	valid_0's auc: 0.891785	valid_1's binary_logloss: 0.139945	valid_1's auc: 0.836228
[36]	valid_0's binary_logloss: 0.117642	valid_0's auc: 0.89242	valid_1's binary_logloss: 0.139981	valid_1's auc: 0.836019
[37]	valid_0's binary_logloss: 0.117331	valid_0's auc: 0.893202	valid_1's binary_logloss: 0.140014	valid_1's auc: 0.835858
[38]	valid_0's binary_logloss: 0.117028	valid_0's auc: 0.893881	valid_1's binary_logloss: 0.140116	valid_1's auc: 0.835594
[39]	valid_0's binary_logloss: 0.11671	valid_0's auc: 0.89439	valid_1's binary_logloss: 0.140166	valid_1's auc: 0.8355
[40]	valid_0's binary_logloss: 0.116439	valid_0's auc: 0.894767	valid_1's binary_logloss: 0.140175	valid_1's auc: 0.835564
[41]	valid_0's binary_logloss: 0.116161	valid_0's auc: 0.895261	valid_1's binary_logloss: 0.140228	valid_1's auc: 0.835399
[42]	valid_0's binary_logloss: 0.115888	valid_0's auc: 0.895782	valid_1's binary_logloss: 0.14032	valid_1's auc: 0.835369
[43]	valid_0's binary_logloss: 0.115655	valid_0's auc: 0.895994	valid_1's binary_logloss: 0.140379	valid_1's auc: 0.835382
[44]	valid_0's binary_logloss: 0.115426	valid_0's auc: 0.896287	valid_1's binary_logloss: 0.140406	valid_1's auc: 0.835169
[45]	valid_0's binary_logloss: 0.115148	valid_0's auc: 0.896767	valid_1's binary_logloss: 0.140418	valid_1's auc: 0.835223
[46]	valid_0's binary_logloss: 0.114846	valid_0's auc: 0.897406	valid_1's binary_logloss: 0.140402	valid_1's auc: 0.835554
[47]	valid_0's binary_logloss: 0.114594	valid_0's auc: 0.897922	valid_1's binary_logloss: 0.140445	valid_1's auc: 0.835407
[48]	valid_0's binary_logloss: 0.114317	valid_0's auc: 0.898413	valid_1's binary_logloss: 0.140451	valid_1's auc: 0.835472
[49]	valid_0's binary_logloss: 0.114115	valid_0's auc: 0.89881	valid_1's binary_logloss: 0.14045	valid_1's auc: 0.835652
[50]	valid_0's binary_logloss: 0.113872	valid_0's auc: 0.89913	valid_1's binary_logloss: 0.1405	valid_1's auc: 0.835727
[51]	valid_0's binary_logloss: 0.113635	valid_0's auc: 0.899546	valid_1's binary_logloss: 0.140435	valid_1's auc: 0.836189
[52]	valid_0's binary_logloss: 0.113446	valid_0's auc: 0.899796	valid_1's binary_logloss: 0.140412	valid_1's auc: 0.836528
[53]	valid_0's binary_logloss: 0.113287	valid_0's auc: 0.899848	valid_1's binary_logloss: 0.140511	valid_1's auc: 0.836191
[54]	valid_0's binary_logloss: 0.113006	valid_0's auc: 0.900303	valid_1's binary_logloss: 0.140619	valid_1's auc: 0.835867
[55]	valid_0's binary_logloss: 0.112738	valid_0's auc: 0.900788	valid_1's binary_logloss: 0.140716	valid_1's auc: 0.835597
[56]	valid_0's binary_logloss: 0.112563	valid_0's auc: 0.900867	valid_1's binary_logloss: 0.140731	valid_1's auc: 0.835775
[57]	valid_0's binary_logloss: 0.112423	valid_0's auc: 0.900882	valid_1's binary_logloss: 0.140747	valid_1's auc: 0.835795
[58]	valid_0's binary_logloss: 0.112179	valid_0's auc: 0.901235	valid_1's binary_logloss: 0.140809	valid_1's auc: 0.835782
Early stopping, best iteration is:
[28]	valid_0's binary_logloss: 0.120555	valid_0's auc: 0.886325	valid_1's binary_logloss: 0.139864	valid_1's auc: 0.837376
[1]	valid_0's binary_logloss: 0.156217	valid_0's auc: 0.824305	valid_1's binary_logloss: 0.165016	valid_1's auc: 0.819488
Training until validation scores don't improve for 30 rounds.
[2]	valid_0's binary_logloss: 0.150957	valid_0's auc: 0.828884	valid_1's binary_logloss: 0.159711	valid_1's auc: 0.822387
[3]	valid_0's binary_logloss: 0.147117	valid_0's auc: 0.838845	valid_1's binary_logloss: 0.156068	valid_1's auc: 0.829542
[4]	valid_0's binary_logloss: 0.144114	valid_0's auc: 0.843406	valid_1's binary_logloss: 0.153141	valid_1's auc: 0.834917
[5]	valid_0's binary_logloss: 0.141629	valid_0's auc: 0.846391	valid_1's binary_logloss: 0.150804	valid_1's auc: 0.837871
[6]	valid_0's binary_logloss: 0.13957	valid_0's auc: 0.848894	valid_1's binary_logloss: 0.148876	valid_1's auc: 0.839548
[7]	valid_0's binary_logloss: 0.137847	valid_0's auc: 0.851133	valid_1's binary_logloss: 0.147225	valid_1's auc: 0.841812
[8]	valid_0's binary_logloss: 0.136394	valid_0's auc: 0.852859	valid_1's binary_logloss: 0.14594	valid_1's auc: 0.842382
[9]	valid_0's binary_logloss: 0.135137	valid_0's auc: 0.854683	valid_1's binary_logloss: 0.144866	valid_1's auc: 0.842811
[10]	valid_0's binary_logloss: 0.134048	valid_0's auc: 0.855596	valid_1's binary_logloss: 0.143872	valid_1's auc: 0.843186
[11]	valid_0's binary_logloss: 0.133075	valid_0's auc: 0.856352	valid_1's binary_logloss: 0.14305	valid_1's auc: 0.843465
[12]	valid_0's binary_logloss: 0.132232	valid_0's auc: 0.857769	valid_1's binary_logloss: 0.142376	valid_1's auc: 0.843222
[13]	valid_0's binary_logloss: 0.131427	valid_0's auc: 0.859429	valid_1's binary_logloss: 0.141783	valid_1's auc: 0.843564
[14]	valid_0's binary_logloss: 0.130658	valid_0's auc: 0.86094	valid_1's binary_logloss: 0.141419	valid_1's auc: 0.843389
[15]	valid_0's binary_logloss: 0.129955	valid_0's auc: 0.862567	valid_1's binary_logloss: 0.141	valid_1's auc: 0.84365
[16]	valid_0's binary_logloss: 0.129293	valid_0's auc: 0.864351	valid_1's binary_logloss: 0.140661	valid_1's auc: 0.84379
[17]	valid_0's binary_logloss: 0.128724	valid_0's auc: 0.865942	valid_1's binary_logloss: 0.140416	valid_1's auc: 0.843552
[18]	valid_0's binary_logloss: 0.128187	valid_0's auc: 0.867233	valid_1's binary_logloss: 0.140054	valid_1's auc: 0.843853
[19]	valid_0's binary_logloss: 0.127637	valid_0's auc: 0.868694	valid_1's binary_logloss: 0.139782	valid_1's auc: 0.844012
[20]	valid_0's binary_logloss: 0.127154	valid_0's auc: 0.86955	valid_1's binary_logloss: 0.139614	valid_1's auc: 0.843654
[21]	valid_0's binary_logloss: 0.126741	valid_0's auc: 0.870481	valid_1's binary_logloss: 0.139406	valid_1's auc: 0.843765
[22]	valid_0's binary_logloss: 0.126309	valid_0's auc: 0.871544	valid_1's binary_logloss: 0.139253	valid_1's auc: 0.844171
[23]	valid_0's binary_logloss: 0.125895	valid_0's auc: 0.872657	valid_1's binary_logloss: 0.139093	valid_1's auc: 0.843901
[24]	valid_0's binary_logloss: 0.125508	valid_0's auc: 0.873871	valid_1's binary_logloss: 0.139015	valid_1's auc: 0.843814
[25]	valid_0's binary_logloss: 0.125076	valid_0's auc: 0.875385	valid_1's binary_logloss: 0.138915	valid_1's auc: 0.843672
[26]	valid_0's binary_logloss: 0.12471	valid_0's auc: 0.876436	valid_1's binary_logloss: 0.138828	valid_1's auc: 0.843894
[27]	valid_0's binary_logloss: 0.124381	valid_0's auc: 0.877113	valid_1's binary_logloss: 0.138723	valid_1's auc: 0.843845
[28]	valid_0's binary_logloss: 0.12406	valid_0's auc: 0.878144	valid_1's binary_logloss: 0.138681	valid_1's auc: 0.843817
[29]	valid_0's binary_logloss: 0.123721	valid_0's auc: 0.879271	valid_1's binary_logloss: 0.13859	valid_1's auc: 0.844032
[30]	valid_0's binary_logloss: 0.123447	valid_0's auc: 0.87995	valid_1's binary_logloss: 0.138538	valid_1's auc: 0.844089
[31]	valid_0's binary_logloss: 0.123148	valid_0's auc: 0.88069	valid_1's binary_logloss: 0.138484	valid_1's auc: 0.844137
[32]	valid_0's binary_logloss: 0.122823	valid_0's auc: 0.881743	valid_1's binary_logloss: 0.138591	valid_1's auc: 0.843246
[33]	valid_0's binary_logloss: 0.122542	valid_0's auc: 0.882558	valid_1's binary_logloss: 0.138654	valid_1's auc: 0.842676
[34]	valid_0's binary_logloss: 0.12228	valid_0's auc: 0.883424	valid_1's binary_logloss: 0.138612	valid_1's auc: 0.842829
[35]	valid_0's binary_logloss: 0.122011	valid_0's auc: 0.88419	valid_1's binary_logloss: 0.138595	valid_1's auc: 0.842651
[36]	valid_0's binary_logloss: 0.121697	valid_0's auc: 0.885075	valid_1's binary_logloss: 0.138593	valid_1's auc: 0.842554
[37]	valid_0's binary_logloss: 0.121404	valid_0's auc: 0.885953	valid_1's binary_logloss: 0.138558	valid_1's auc: 0.842654
[38]	valid_0's binary_logloss: 0.121133	valid_0's auc: 0.887245	valid_1's binary_logloss: 0.138548	valid_1's auc: 0.842656
[39]	valid_0's binary_logloss: 0.120851	valid_0's auc: 0.887995	valid_1's binary_logloss: 0.138472	valid_1's auc: 0.842756
[40]	valid_0's binary_logloss: 0.120601	valid_0's auc: 0.888693	valid_1's binary_logloss: 0.138411	valid_1's auc: 0.842976
[41]	valid_0's binary_logloss: 0.120343	valid_0's auc: 0.889439	valid_1's binary_logloss: 0.138364	valid_1's auc: 0.843062
[42]	valid_0's binary_logloss: 0.120105	valid_0's auc: 0.890032	valid_1's binary_logloss: 0.138358	valid_1's auc: 0.842992
[43]	valid_0's binary_logloss: 0.11989	valid_0's auc: 0.890657	valid_1's binary_logloss: 0.138331	valid_1's auc: 0.843118
[44]	valid_0's binary_logloss: 0.119626	valid_0's auc: 0.891757	valid_1's binary_logloss: 0.1383	valid_1's auc: 0.843283
[45]	valid_0's binary_logloss: 0.119426	valid_0's auc: 0.892343	valid_1's binary_logloss: 0.138306	valid_1's auc: 0.84332
[46]	valid_0's binary_logloss: 0.119211	valid_0's auc: 0.892986	valid_1's binary_logloss: 0.138288	valid_1's auc: 0.843346
[47]	valid_0's binary_logloss: 0.119028	valid_0's auc: 0.89341	valid_1's binary_logloss: 0.138241	valid_1's auc: 0.843385
[48]	valid_0's binary_logloss: 0.118789	valid_0's auc: 0.894062	valid_1's binary_logloss: 0.138298	valid_1's auc: 0.843166
[49]	valid_0's binary_logloss: 0.118543	valid_0's auc: 0.894734	valid_1's binary_logloss: 0.138271	valid_1's auc: 0.843193
[50]	valid_0's binary_logloss: 0.118352	valid_0's auc: 0.895288	valid_1's binary_logloss: 0.138309	valid_1's auc: 0.842965
[51]	valid_0's binary_logloss: 0.118145	valid_0's auc: 0.895902	valid_1's binary_logloss: 0.138343	valid_1's auc: 0.842827
[52]	valid_0's binary_logloss: 0.11792	valid_0's auc: 0.896512	valid_1's binary_logloss: 0.138311	valid_1's auc: 0.842926
Early stopping, best iteration is:
[22]	valid_0's binary_logloss: 0.126309	valid_0's auc: 0.871544	valid_1's binary_logloss: 0.139253	valid_1's auc: 0.844171
GridSearchCV 최적 파라미터: {'max_depth': 128, 'min_child_samples': 100, 'num_leaves': 32, 'subsample': 0.8}
ROC AUC: 0.8442

In [21]:

# 해당 하이퍼 파라미터로 다시 학습
lgbm_clf = LGBMClassifier(n_estimators=1000, num_leaves=32, sumbsample=0.8, min_child_samples=100,
                          max_depth=128)

evals = [(X_test, y_test)]
lgbm_clf.fit(X_train, y_train, early_stopping_rounds=100, eval_metric="auc", eval_set=evals,
                verbose=True)

lgbm_roc_score = roc_auc_score(y_test, lgbm_clf.predict_proba(X_test)[:,1],average='macro')
print('ROC AUC: {0:.4f}'.format(lgbm_roc_score))

[1]	valid_0's binary_logloss: 0.165016	valid_0's auc: 0.819488
Training until validation scores don't improve for 100 rounds.
[2]	valid_0's binary_logloss: 0.159711	valid_0's auc: 0.822387
[3]	valid_0's binary_logloss: 0.156068	valid_0's auc: 0.829542
[4]	valid_0's binary_logloss: 0.153141	valid_0's auc: 0.834917
[5]	valid_0's binary_logloss: 0.150804	valid_0's auc: 0.837871
[6]	valid_0's binary_logloss: 0.148876	valid_0's auc: 0.839548
[7]	valid_0's binary_logloss: 0.147225	valid_0's auc: 0.841812
[8]	valid_0's binary_logloss: 0.14594	valid_0's auc: 0.842382
[9]	valid_0's binary_logloss: 0.144866	valid_0's auc: 0.842811
[10]	valid_0's binary_logloss: 0.143872	valid_0's auc: 0.843186
[11]	valid_0's binary_logloss: 0.14305	valid_0's auc: 0.843465
[12]	valid_0's binary_logloss: 0.142376	valid_0's auc: 0.843222
[13]	valid_0's binary_logloss: 0.141783	valid_0's auc: 0.843564
[14]	valid_0's binary_logloss: 0.141419	valid_0's auc: 0.843389
[15]	valid_0's binary_logloss: 0.141	valid_0's auc: 0.84365
[16]	valid_0's binary_logloss: 0.140661	valid_0's auc: 0.84379
[17]	valid_0's binary_logloss: 0.140416	valid_0's auc: 0.843552
[18]	valid_0's binary_logloss: 0.140054	valid_0's auc: 0.843853
[19]	valid_0's binary_logloss: 0.139782	valid_0's auc: 0.844012
[20]	valid_0's binary_logloss: 0.139614	valid_0's auc: 0.843654
[21]	valid_0's binary_logloss: 0.139406	valid_0's auc: 0.843765
[22]	valid_0's binary_logloss: 0.139253	valid_0's auc: 0.844171
[23]	valid_0's binary_logloss: 0.139093	valid_0's auc: 0.843901
[24]	valid_0's binary_logloss: 0.139015	valid_0's auc: 0.843814
[25]	valid_0's binary_logloss: 0.138915	valid_0's auc: 0.843672
[26]	valid_0's binary_logloss: 0.138828	valid_0's auc: 0.843894
[27]	valid_0's binary_logloss: 0.138723	valid_0's auc: 0.843845
[28]	valid_0's binary_logloss: 0.138681	valid_0's auc: 0.843817
[29]	valid_0's binary_logloss: 0.13859	valid_0's auc: 0.844032
[30]	valid_0's binary_logloss: 0.138538	valid_0's auc: 0.844089
[31]	valid_0's binary_logloss: 0.138484	valid_0's auc: 0.844137
[32]	valid_0's binary_logloss: 0.138591	valid_0's auc: 0.843246
[33]	valid_0's binary_logloss: 0.138654	valid_0's auc: 0.842676
[34]	valid_0's binary_logloss: 0.138612	valid_0's auc: 0.842829
[35]	valid_0's binary_logloss: 0.138595	valid_0's auc: 0.842651
[36]	valid_0's binary_logloss: 0.138593	valid_0's auc: 0.842554
[37]	valid_0's binary_logloss: 0.138558	valid_0's auc: 0.842654
[38]	valid_0's binary_logloss: 0.138548	valid_0's auc: 0.842656
[39]	valid_0's binary_logloss: 0.138472	valid_0's auc: 0.842756
[40]	valid_0's binary_logloss: 0.138411	valid_0's auc: 0.842976
[41]	valid_0's binary_logloss: 0.138364	valid_0's auc: 0.843062
[42]	valid_0's binary_logloss: 0.138358	valid_0's auc: 0.842992
[43]	valid_0's binary_logloss: 0.138331	valid_0's auc: 0.843118
[44]	valid_0's binary_logloss: 0.1383	valid_0's auc: 0.843283
[45]	valid_0's binary_logloss: 0.138306	valid_0's auc: 0.84332
[46]	valid_0's binary_logloss: 0.138288	valid_0's auc: 0.843346
[47]	valid_0's binary_logloss: 0.138241	valid_0's auc: 0.843385
[48]	valid_0's binary_logloss: 0.138298	valid_0's auc: 0.843166
[49]	valid_0's binary_logloss: 0.138271	valid_0's auc: 0.843193
[50]	valid_0's binary_logloss: 0.138309	valid_0's auc: 0.842965
[51]	valid_0's binary_logloss: 0.138343	valid_0's auc: 0.842827
[52]	valid_0's binary_logloss: 0.138311	valid_0's auc: 0.842926
[53]	valid_0's binary_logloss: 0.138328	valid_0's auc: 0.842742
[54]	valid_0's binary_logloss: 0.138369	valid_0's auc: 0.842496
[55]	valid_0's binary_logloss: 0.138337	valid_0's auc: 0.84257
[56]	valid_0's binary_logloss: 0.138253	valid_0's auc: 0.8428
[57]	valid_0's binary_logloss: 0.138319	valid_0's auc: 0.842529
[58]	valid_0's binary_logloss: 0.138333	valid_0's auc: 0.8424
[59]	valid_0's binary_logloss: 0.138374	valid_0's auc: 0.842268
[60]	valid_0's binary_logloss: 0.13834	valid_0's auc: 0.84235
[61]	valid_0's binary_logloss: 0.138426	valid_0's auc: 0.84188
[62]	valid_0's binary_logloss: 0.138441	valid_0's auc: 0.841824
[63]	valid_0's binary_logloss: 0.138494	valid_0's auc: 0.841519
[64]	valid_0's binary_logloss: 0.138494	valid_0's auc: 0.841793
[65]	valid_0's binary_logloss: 0.138541	valid_0's auc: 0.841631
[66]	valid_0's binary_logloss: 0.138558	valid_0's auc: 0.841514
[67]	valid_0's binary_logloss: 0.138553	valid_0's auc: 0.841441
[68]	valid_0's binary_logloss: 0.138581	valid_0's auc: 0.841335
[69]	valid_0's binary_logloss: 0.13866	valid_0's auc: 0.841157
[70]	valid_0's binary_logloss: 0.138604	valid_0's auc: 0.841363
[71]	valid_0's binary_logloss: 0.138608	valid_0's auc: 0.841247
[72]	valid_0's binary_logloss: 0.138616	valid_0's auc: 0.841129
[73]	valid_0's binary_logloss: 0.13859	valid_0's auc: 0.841231
[74]	valid_0's binary_logloss: 0.138651	valid_0's auc: 0.841063
[75]	valid_0's binary_logloss: 0.138603	valid_0's auc: 0.841226
[76]	valid_0's binary_logloss: 0.13862	valid_0's auc: 0.841163
[77]	valid_0's binary_logloss: 0.138597	valid_0's auc: 0.841357
[78]	valid_0's binary_logloss: 0.138687	valid_0's auc: 0.840873
[79]	valid_0's binary_logloss: 0.138734	valid_0's auc: 0.840753
[80]	valid_0's binary_logloss: 0.138741	valid_0's auc: 0.840892
[81]	valid_0's binary_logloss: 0.138702	valid_0's auc: 0.841138
[82]	valid_0's binary_logloss: 0.138712	valid_0's auc: 0.841058
[83]	valid_0's binary_logloss: 0.138768	valid_0's auc: 0.84078
[84]	valid_0's binary_logloss: 0.138815	valid_0's auc: 0.84061
[85]	valid_0's binary_logloss: 0.138849	valid_0's auc: 0.840361
[86]	valid_0's binary_logloss: 0.138871	valid_0's auc: 0.840272
[87]	valid_0's binary_logloss: 0.138909	valid_0's auc: 0.840075
[88]	valid_0's binary_logloss: 0.138874	valid_0's auc: 0.840357
[89]	valid_0's binary_logloss: 0.138905	valid_0's auc: 0.840169
[90]	valid_0's binary_logloss: 0.1389	valid_0's auc: 0.840125
[91]	valid_0's binary_logloss: 0.139015	valid_0's auc: 0.839679
[92]	valid_0's binary_logloss: 0.138999	valid_0's auc: 0.83983
[93]	valid_0's binary_logloss: 0.139006	valid_0's auc: 0.839799
[94]	valid_0's binary_logloss: 0.13898	valid_0's auc: 0.839851
[95]	valid_0's binary_logloss: 0.13892	valid_0's auc: 0.840149
[96]	valid_0's binary_logloss: 0.138954	valid_0's auc: 0.840139
[97]	valid_0's binary_logloss: 0.138986	valid_0's auc: 0.840006
[98]	valid_0's binary_logloss: 0.139033	valid_0's auc: 0.839846
[99]	valid_0's binary_logloss: 0.139075	valid_0's auc: 0.839834
[100]	valid_0's binary_logloss: 0.139137	valid_0's auc: 0.839472
[101]	valid_0's binary_logloss: 0.139155	valid_0's auc: 0.8394
[102]	valid_0's binary_logloss: 0.139154	valid_0's auc: 0.839448
[103]	valid_0's binary_logloss: 0.139134	valid_0's auc: 0.839538
[104]	valid_0's binary_logloss: 0.139161	valid_0's auc: 0.839496
[105]	valid_0's binary_logloss: 0.139125	valid_0's auc: 0.839596
[106]	valid_0's binary_logloss: 0.139115	valid_0's auc: 0.839639
[107]	valid_0's binary_logloss: 0.139097	valid_0's auc: 0.839791
[108]	valid_0's binary_logloss: 0.139097	valid_0's auc: 0.839814
[109]	valid_0's binary_logloss: 0.139135	valid_0's auc: 0.839695
[110]	valid_0's binary_logloss: 0.139206	valid_0's auc: 0.839293
[111]	valid_0's binary_logloss: 0.139196	valid_0's auc: 0.839318
[112]	valid_0's binary_logloss: 0.139234	valid_0's auc: 0.839257
[113]	valid_0's binary_logloss: 0.139234	valid_0's auc: 0.839251
[114]	valid_0's binary_logloss: 0.139242	valid_0's auc: 0.839284
[115]	valid_0's binary_logloss: 0.139253	valid_0's auc: 0.839367
[116]	valid_0's binary_logloss: 0.139255	valid_0's auc: 0.83942
[117]	valid_0's binary_logloss: 0.139294	valid_0's auc: 0.839346
[118]	valid_0's binary_logloss: 0.139357	valid_0's auc: 0.839207
[119]	valid_0's binary_logloss: 0.139392	valid_0's auc: 0.839105
[120]	valid_0's binary_logloss: 0.139375	valid_0's auc: 0.839302
[121]	valid_0's binary_logloss: 0.139363	valid_0's auc: 0.839406
[122]	valid_0's binary_logloss: 0.139379	valid_0's auc: 0.83949
Early stopping, best iteration is:
[22]	valid_0's binary_logloss: 0.139253	valid_0's auc: 0.844171
ROC AUC: 0.8442

In [ ]:

저작자표시 비영리 변경금지

'머신러닝' 카테고리의 다른 글

[파이썬 머신러닝] 4장. 스태킹 앙상블 (0)	2021.01.20
[파이썬 머신러닝] 4장. 신용카드 사기 검출 (0)	2021.01.19
[파이썬 머신러닝] 4장. 결정트리 (0)	2021.01.14
[파이썬 머신러닝] 3장. 당뇨병 예측 (0)	2021.01.14
[파이썬 머신러닝] 2장. 타이타닉 생존자 예측 (0)	2021.01.14

dlsalfkd11 코딩코딩

[파이썬 머신러닝] 4장. 산탄데르 고객 예측

'머신러닝' 카테고리의 다른 글

티스토리툴바

[파이썬 머신러닝] 4장. 산탄데르 고객 예측

'머신러닝' 카테고리의 다른 글

'머신러닝' Related Articles

티스토리툴바