训练完之后为什么回测出了错误呢?


(wygwsg) #1
克隆策略

使用深度学习技术预测股票价格

版本 v1.0

目录

  • ### 深度学习策略的交易规则

  • ### 策略构建步骤

  • ### 策略的实现

正文

一、深度学习策略的交易规则

  • 买入条件:预测的上涨概率>0.5,则买入或保持已有持仓。
  • 卖出条件 :预测的上涨概率<0.5,则卖出已有股票。

二、策略构建步骤

1、确定股票池和数据起止时间

  • 在证券代码列表m24模块中输入要回测的单只股票,以及数据的起止日期(含训练集和验证集)。

2、确定因子

  • 在输入特征列表m8模块中输入用于预测的N个因子表达式。

3、获取基础数据

  • 通过自定义模块m23获取指定股票池的基础数据,如收盘价等字段。

4、确定并计算模型标注

  • 通过自定义模块m16计算需要的标注指标,本例中首先计算未来10天收益df['return'],然后根据df['return']的正负来给每日数据标注1或0,来标识涨跌。

5、抽取因子数据

  • 通过衍生数据抽取模块m26计算因子数据。

6、合并标注与因子数据

  • 通过连接数据m17模块合并因子数据和标注数据。

7、划分训练集和预测集

  • 通过数据过滤模块m19和m20中设置的日期范围划分训练集数据和预测集数据。

8、生成序列窗口滚动数据集

  • 通过序列窗口滚动(深度学习)模块将训练集和预测集的数据生成固定窗口长度的数据序列,为后续模型训练和预测做准备。

9、构建LSTM + CNN模型构架

  • 在画布左侧模块列表中依次拖入输入层模块、Reshape层模块、Conv2D层模块、Reshape层模块、LSTM层模块、Dropout层模块和全连接层模块(两组),构成深度学习网络构架,

    最后通过“构建(深度学习)”模块组装各层。这里需要注意:

    输入层的shape参数是 窗口滚动数据集的大小 X 因子数量 , 本例为 50 行 X 5个因子

    ReShape层的参数是 窗口滚动数据集的大小 X 因子数量 X 1 ,本例为 50 行 X 5个因子 X1

    Conv2D层中的 kernel_size参数是滑动窗口的尺寸,本例中使用 3行 X 5列 的窗口, 每次滑动的步长为 1行 X 1列 , 卷积核数目为32,这里的窗口设置决定了后面ReShape层的参数

    ReShape层中的target_shape 参数,这是由 窗口滚动数据集 X 因子数量 和 Conv2D层中设置的窗口尺寸以及步长决定的。本例中 50行 X 5因子 的输入数据,使用 3行 X5列 的窗口滑动取数据,

    每次移动1行,共计可以得到48次数据(即可以通过滑动3行 X 5列的窗口48次来获取完整的数据),因此target_shape= 48 X 卷积核数32

    LSTM层的输出空间维度设置为卷积核数32,并设置激活函数

    Dropout层是防止过度拟合采用的主动裁剪数据技术,这里设置rate 为0.8

    全连接层共两层,第一层的输出空间维度与LSTM的输出维度保持一致为32,第二层将第一层的32维数据转变为1维数据输出,即获取预测的label值,此例为0到1之间的连续值,可以认为是上涨的概率。

10、训练深度学习模型

  • 在画布左侧模块列表中拖入“训练(深度学习)”模块m6,设置属性中的优化器、目标函数、评估指标、每次训练的数据量batch_size、迭代次数epochs和GPU的数量以及日志输出频率。

11、使用深度学习模型预测

  • 在画布左侧模块列表中拖入“预测(深度学习)”模块m7,并将“训练(深度学习)”模块m6的模型输出和验证集的序列窗口滚动数据集传给预测模块,通过预测模块即根据股票验证集的数据预测上涨的概率。

12、根据模型预测结果构建策略

  • 如果当日预测的上涨概率大于0.5,则保持持仓或买入

  • 如果当日预测的上涨概率小于0.5,则卖出股票或保持空仓。

13、模拟回测

  • 通过 trade 模块中的初始化函数定义交易手续费和滑点,通过 context.prediction 获取每日的上涨概率预测结果;

  • 通过 trade 模块中的主函数(handle函数)查看每日的买卖交易信号,按照买卖原则执行相应的买入/卖出操作。

三、策略的实现

可视化策略实现如下:

    {"Description":"实验创建于2017/11/15","Summary":"","Graph":{"EdgesInternal":[{"DestinationInputPortId":"-281:options_data","SourceOutputPortId":"-214:data_1"},{"DestinationInputPortId":"-316:inputs","SourceOutputPortId":"-210:data"},{"DestinationInputPortId":"-403:inputs","SourceOutputPortId":"-210:data"},{"DestinationInputPortId":"-14834:inputs","SourceOutputPortId":"-218:data"},{"DestinationInputPortId":"-320:input_model","SourceOutputPortId":"-316:data"},{"DestinationInputPortId":"-332:trained_model","SourceOutputPortId":"-320:data"},{"DestinationInputPortId":"-214:input_1","SourceOutputPortId":"-332:data"},{"DestinationInputPortId":"-692:features","SourceOutputPortId":"-2295:data"},{"DestinationInputPortId":"-285:features","SourceOutputPortId":"-2295:data"},{"DestinationInputPortId":"-293:features","SourceOutputPortId":"-2295:data"},{"DestinationInputPortId":"-316:outputs","SourceOutputPortId":"-259:data"},{"DestinationInputPortId":"-14841:inputs","SourceOutputPortId":"-14806:data"},{"DestinationInputPortId":"-14806:inputs","SourceOutputPortId":"-14834:data"},{"DestinationInputPortId":"-259:inputs","SourceOutputPortId":"-14841:data"},{"DestinationInputPortId":"-408:inputs","SourceOutputPortId":"-403:data"},{"DestinationInputPortId":"-446:inputs","SourceOutputPortId":"-408:data"},{"DestinationInputPortId":"-218:inputs","SourceOutputPortId":"-446:data"},{"DestinationInputPortId":"-2290:data1","SourceOutputPortId":"-1966:data_1"},{"DestinationInputPortId":"-2296:input_data","SourceOutputPortId":"-2290:data"},{"DestinationInputPortId":"-2300:input_data","SourceOutputPortId":"-2296:data"},{"DestinationInputPortId":"-2306:input_data","SourceOutputPortId":"-2296:data"},{"DestinationInputPortId":"-285:input_data","SourceOutputPortId":"-2300:data"},{"DestinationInputPortId":"-214:input_3","SourceOutputPortId":"-2306:data"},{"DestinationInputPortId":"-293:input_data","SourceOutputPortId":"-2306:data"},{"DestinationInputPortId":"-1966:input_1","SourceOutputPortId":"-616:data_1"},{"DestinationInputPortId":"-692:input_data","SourceOutputPortId":"-616:data_1"},{"DestinationInputPortId":"-616:input_1","SourceOutputPortId":"-620:data"},{"DestinationInputPortId":"-281:instruments","SourceOutputPortId":"-620:data"},{"DestinationInputPortId":"-2290:data2","SourceOutputPortId":"-692:data"},{"DestinationInputPortId":"-320:training_data","SourceOutputPortId":"-285:data"},{"DestinationInputPortId":"-332:input_data","SourceOutputPortId":"-293:data"},{"DestinationInputPortId":"-214:input_2","SourceOutputPortId":"-293:data"}],"ModuleNodes":[{"Id":"-214","ModuleId":"BigQuantSpace.cached.cached-v3","ModuleParameters":[{"Name":"run","Value":"# Python 代码入口函数,input_1/2/3 对应三个输入端,data_1/2/3 对应三个输出端\ndef bigquant_run(input_1, input_2, input_3):\n input_series = input_1\n input_df = input_2\n test_data = input_df.read_pickle()\n pred_label = input_series.read_pickle()\n \n pred_result = pred_label.reshape(pred_label.shape[0]) \n dt = input_3.read_df()['date'][-1*len(pred_result):]\n pred_df = pd.Series(pred_result, index=dt)\n ds = DataSource.write_df(pred_df)\n \n pred_label = np.where(pred_label>0.5,1,0)\n labels = test_data['y']\n print('准确率%s'%(np.mean(pred_label==labels)))\n \n return Outputs(data_1=ds)\n","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"post_run","Value":"# 后处理函数,可选。输入是主函数的输出,可以在这里对数据做处理,或者返回更友好的outputs数据格式。此函数输出不会被缓存。\ndef bigquant_run(outputs):\n return outputs\n","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"input_ports","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"params","Value":"{}","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"output_ports","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_1","NodeId":"-214"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_2","NodeId":"-214"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_3","NodeId":"-214"}],"OutputPortsInternal":[{"Name":"data_1","NodeId":"-214","OutputType":null},{"Name":"data_2","NodeId":"-214","OutputType":null},{"Name":"data_3","NodeId":"-214","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":2,"IsPartOfPartialRun":null,"Comment":"模型预测结果输出","CommentCollapsed":false},{"Id":"-210","ModuleId":"BigQuantSpace.dl_layer_input.dl_layer_input-v1","ModuleParameters":[{"Name":"shape","Value":"50,15","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"batch_shape","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"dtype","Value":"float32","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"sparse","Value":"False","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"name","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"inputs","NodeId":"-210"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-210","OutputType":null}],"UsePreviousResults":false,"moduleIdForCode":3,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-218","ModuleId":"BigQuantSpace.dl_layer_lstm.dl_layer_lstm-v1","ModuleParameters":[{"Name":"units","Value":"32","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activation","Value":"tanh","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_activation","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"recurrent_activation","Value":"hard_sigmoid","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_recurrent_activation","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"use_bias","Value":"True","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_initializer","Value":"glorot_uniform","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_initializer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"recurrent_initializer","Value":"Orthogonal","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_recurrent_initializer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_initializer","Value":"Ones","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_initializer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"unit_forget_bias","Value":"True","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"recurrent_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"recurrent_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"recurrent_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_recurrent_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_activity_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_constraint","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_constraint","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"recurrent_constraint","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_recurrent_constraint","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_constraint","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_constraint","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"dropout","Value":"0","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"recurrent_dropout","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"return_sequences","Value":"False","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"implementation","Value":"0","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"name","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"inputs","NodeId":"-218"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-218","OutputType":null}],"UsePreviousResults":false,"moduleIdForCode":4,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-316","ModuleId":"BigQuantSpace.dl_model_init.dl_model_init-v1","ModuleParameters":[],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"inputs","NodeId":"-316"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"outputs","NodeId":"-316"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-316","OutputType":null}],"UsePreviousResults":false,"moduleIdForCode":5,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-320","ModuleId":"BigQuantSpace.dl_model_train.dl_model_train-v1","ModuleParameters":[{"Name":"optimizer","Value":"Adam","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_optimizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"loss","Value":"binary_crossentropy","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_loss","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"metrics","Value":"accuracy","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"batch_size","Value":"2048","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"epochs","Value":"3000","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"n_gpus","Value":"0","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"verbose","Value":"1:输出进度条记录","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_model","NodeId":"-320"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"training_data","NodeId":"-320"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"validation_data","NodeId":"-320"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-320","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":6,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-332","ModuleId":"BigQuantSpace.dl_model_predict.dl_model_predict-v1","ModuleParameters":[{"Name":"batch_size","Value":"10240","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"n_gpus","Value":"0","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"verbose","Value":"2:每个epoch输出一行记录","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"trained_model","NodeId":"-332"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_data","NodeId":"-332"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-332","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":7,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-2295","ModuleId":"BigQuantSpace.input_features.input_features-v1","ModuleParameters":[{"Name":"features","Value":"(close/shift(close,1)-1)*10\n(high/shift(high,1)-1)*10\n(low/shift(low,1)-1)*10\n(open/shift(open,1)-1)*10\n(volume/shift(volume,1)-1)*10\nta_ma(close, derive='golden_cross')\nta_ma(close, derive='death_cross')\nta_kdj(high, low, close, 20, 20, 20, 'golden_cross')\nta_kdj(high, low, close, 80, 80, 80, 'death_cross')\nta_macd(close,'golden_cross')\nta_macd(close,'death_cross')\nta_trix(close, derive='golden_cross')\nta_trix(close, derive='death_cross')\nta_adx(high, low, close, 14)\nta_bbands_u(close, 14)\n","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"features_ds","NodeId":"-2295"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-2295","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":8,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-259","ModuleId":"BigQuantSpace.dl_layer_dense.dl_layer_dense-v1","ModuleParameters":[{"Name":"units","Value":"1","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activation","Value":"sigmoid","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_activation","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"use_bias","Value":"True","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_initializer","Value":"glorot_uniform","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_initializer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_initializer","Value":"Zeros","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_initializer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_activity_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_constraint","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_constraint","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_constraint","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_constraint","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"name","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"inputs","NodeId":"-259"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-259","OutputType":null}],"UsePreviousResults":false,"moduleIdForCode":9,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-14806","ModuleId":"BigQuantSpace.dl_layer_dense.dl_layer_dense-v1","ModuleParameters":[{"Name":"units","Value":"32","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activation","Value":"tanh","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_activation","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"use_bias","Value":"True","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_initializer","Value":"glorot_uniform","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_initializer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_initializer","Value":"Zeros","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_initializer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_activity_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_constraint","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_constraint","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_constraint","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_constraint","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"name","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"inputs","NodeId":"-14806"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-14806","OutputType":null}],"UsePreviousResults":false,"moduleIdForCode":10,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-14834","ModuleId":"BigQuantSpace.dl_layer_dropout.dl_layer_dropout-v1","ModuleParameters":[{"Name":"rate","Value":"0.001","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"noise_shape","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"seed","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"name","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"inputs","NodeId":"-14834"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-14834","OutputType":null}],"UsePreviousResults":false,"moduleIdForCode":11,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-14841","ModuleId":"BigQuantSpace.dl_layer_dropout.dl_layer_dropout-v1","ModuleParameters":[{"Name":"rate","Value":"0.001","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"noise_shape","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"seed","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"name","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"inputs","NodeId":"-14841"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-14841","OutputType":null}],"UsePreviousResults":false,"moduleIdForCode":12,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-403","ModuleId":"BigQuantSpace.dl_layer_reshape.dl_layer_reshape-v1","ModuleParameters":[{"Name":"target_shape","Value":"50,15,1","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"name","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"inputs","NodeId":"-403"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-403","OutputType":null}],"UsePreviousResults":false,"moduleIdForCode":13,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-408","ModuleId":"BigQuantSpace.dl_layer_conv2d.dl_layer_conv2d-v1","ModuleParameters":[{"Name":"filters","Value":"32","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_size","Value":"3,5","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"strides","Value":"1,1","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"padding","Value":"valid","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"data_format","Value":"channels_last","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"dilation_rate","Value":"1,1","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activation","Value":"relu","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_activation","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"use_bias","Value":"True","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_initializer","Value":"glorot_uniform","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_initializer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_initializer","Value":"Zeros","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_initializer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer_l1","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"activity_regularizer_l2","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_activity_regularizer","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"kernel_constraint","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_kernel_constraint","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"bias_constraint","Value":"None","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_bias_constraint","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"name","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"inputs","NodeId":"-408"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-408","OutputType":null}],"UsePreviousResults":false,"moduleIdForCode":14,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-446","ModuleId":"BigQuantSpace.dl_layer_reshape.dl_layer_reshape-v1","ModuleParameters":[{"Name":"target_shape","Value":"132,128","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"name","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"inputs","NodeId":"-446"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-446","OutputType":null}],"UsePreviousResults":false,"moduleIdForCode":15,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-1966","ModuleId":"BigQuantSpace.cached.cached-v3","ModuleParameters":[{"Name":"run","Value":"# Python 代码入口函数,input_1/2/3 对应三个输入端,data_1/2/3 对应三个输出端\ndef bigquant_run(input_1, input_2, input_3):\n input_ds = input_1\n df = input_ds.read_df()\n df['return'] = (df.close.shift(-5)/df.close - 1)\n df['label'] = np.where(df['return'] > 0, 1, 0)\n ds = DataSource.write_df(df[['date','instrument','label']])\n return Outputs(data_1=ds)\n\n","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"post_run","Value":"# 后处理函数,可选。输入是主函数的输出,可以在这里对数据做处理,或者返回更友好的outputs数据格式。此函数输出不会被缓存。\ndef bigquant_run(outputs):\n return outputs\n","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"input_ports","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"params","Value":"{}","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"output_ports","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_1","NodeId":"-1966"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_2","NodeId":"-1966"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_3","NodeId":"-1966"}],"OutputPortsInternal":[{"Name":"data_1","NodeId":"-1966","OutputType":null},{"Name":"data_2","NodeId":"-1966","OutputType":null},{"Name":"data_3","NodeId":"-1966","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":16,"IsPartOfPartialRun":null,"Comment":"数据标注","CommentCollapsed":false},{"Id":"-2290","ModuleId":"BigQuantSpace.join.join-v3","ModuleParameters":[{"Name":"on","Value":"date,instrument","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"how","Value":"inner","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"sort","Value":"True","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"data1","NodeId":"-2290"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"data2","NodeId":"-2290"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-2290","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":17,"IsPartOfPartialRun":null,"Comment":"标注特征连接","CommentCollapsed":false},{"Id":"-2296","ModuleId":"BigQuantSpace.dropnan.dropnan-v1","ModuleParameters":[],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_data","NodeId":"-2296"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-2296","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":18,"IsPartOfPartialRun":null,"Comment":"去掉为nan的数据","CommentCollapsed":true},{"Id":"-2300","ModuleId":"BigQuantSpace.filter.filter-v3","ModuleParameters":[{"Name":"expr","Value":"date<'2017-06-01'","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"output_left_data","Value":"False","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_data","NodeId":"-2300"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-2300","OutputType":null},{"Name":"left_data","NodeId":"-2300","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":19,"IsPartOfPartialRun":null,"Comment":"训练数据","CommentCollapsed":false},{"Id":"-2306","ModuleId":"BigQuantSpace.filter.filter-v3","ModuleParameters":[{"Name":"expr","Value":"date>'2017-06-01'","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"output_left_data","Value":"False","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_data","NodeId":"-2306"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-2306","OutputType":null},{"Name":"left_data","NodeId":"-2306","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":20,"IsPartOfPartialRun":null,"Comment":"测试数据","CommentCollapsed":false},{"Id":"-616","ModuleId":"BigQuantSpace.cached.cached-v3","ModuleParameters":[{"Name":"run","Value":"# Python 代码入口函数,input_1/2/3 对应三个输入端,data_1/2/3 对应三个输出端\ndef bigquant_run(input_1, input_2, input_3):\n fields = ['open','high','low','close','volume']\n input_1_df = input_1.read_pickle()\n ins = input_1_df['instruments']\n start_date = input_1_df['start_date']\n end_date = input_1_df['end_date']\n df = D.history_data(ins, start_date, end_date, fields) \n data_1 = DataSource.write_df(df)\n return Outputs(data_1=data_1, data_2=None, data_3=None)\n","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"post_run","Value":"# 后处理函数,可选。输入是主函数的输出,可以在这里对数据做处理,或者返回更友好的outputs数据格式。此函数输出不会被缓存。\ndef bigquant_run(outputs):\n return outputs\n","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"input_ports","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"params","Value":"{}","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"output_ports","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_1","NodeId":"-616"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_2","NodeId":"-616"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_3","NodeId":"-616"}],"OutputPortsInternal":[{"Name":"data_1","NodeId":"-616","OutputType":null},{"Name":"data_2","NodeId":"-616","OutputType":null},{"Name":"data_3","NodeId":"-616","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":23,"IsPartOfPartialRun":null,"Comment":"获取基本数据","CommentCollapsed":false},{"Id":"-620","ModuleId":"BigQuantSpace.instruments.instruments-v2","ModuleParameters":[{"Name":"start_date","Value":"2005-01-01","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"end_date","Value":"2019-10-30","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"market","Value":"CN_STOCK_A","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"instrument_list","Value":"600699.SHA","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"max_count","Value":0,"ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"rolling_conf","NodeId":"-620"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-620","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":24,"IsPartOfPartialRun":null,"Comment":"证券标的及起始截止时间","CommentCollapsed":false},{"Id":"-692","ModuleId":"BigQuantSpace.derived_feature_extractor.derived_feature_extractor-v3","ModuleParameters":[{"Name":"date_col","Value":"date","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"instrument_col","Value":"instrument","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"drop_na","Value":"False","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"remove_extra_columns","Value":"False","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"user_functions","Value":"{}","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_data","NodeId":"-692"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"features","NodeId":"-692"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-692","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":26,"IsPartOfPartialRun":null,"Comment":"计算需要使用的特征","CommentCollapsed":false},{"Id":"-281","ModuleId":"BigQuantSpace.trade.trade-v4","ModuleParameters":[{"Name":"start_date","Value":"2017-04-01","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"end_date","Value":"","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"initialize","Value":"# 回测引擎:初始化函数,只执行一次\ndef bigquant_run(context):\n # 加载预测数据\n context.prediction = context.options['data'].read_df()\n\n # 系统已经设置了默认的交易手续费和滑点,要修改手续费可使用如下函数\n context.set_commission(PerOrder(buy_cost=0.0003, sell_cost=0.0013, min_cost=5))","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"handle_data","Value":"# 回测引擎:每日数据处理函数,每天执行一次\ndef bigquant_run(context, data):\n # 按日期过滤得到今日的预测数据\n try:\n prediction = context.prediction[data.current_dt.strftime('%Y-%m-%d')]\n except KeyError as e:\n return\n \n instrument = context.instruments[0]\n sid = context.symbol(instrument)\n cur_position = context.portfolio.positions[sid].amount\n \n # 交易逻辑\n if prediction > 0.7 and cur_position == 0:\n context.order_target_percent(context.symbol(instrument), 1)\n print(data.current_dt, '买入!')\n \n elif prediction < 0.5 and cur_position > 0:\n context.order_target_percent(context.symbol(instrument), 0)\n print(data.current_dt, '卖出!')\n ","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"prepare","Value":"# 回测引擎:准备数据,只执行一次\ndef bigquant_run(context):\n pass\n","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"before_trading_start","Value":"# 回测引擎:每个单位时间开始前调用一次,即每日开盘前调用一次。\ndef bigquant_run(context, data):\n pass\n","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"volume_limit","Value":0.025,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"order_price_field_buy","Value":"open","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"order_price_field_sell","Value":"close","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"capital_base","Value":1000000,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"auto_cancel_non_tradable_orders","Value":"True","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"data_frequency","Value":"daily","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"price_type","Value":"真实价格","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"product_type","Value":"股票","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"plot_charts","Value":"True","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"backtest_only","Value":"False","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"benchmark","Value":"","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"instruments","NodeId":"-281"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"options_data","NodeId":"-281"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"history_ds","NodeId":"-281"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"benchmark_ds","NodeId":"-281"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"trading_calendar","NodeId":"-281"}],"OutputPortsInternal":[{"Name":"raw_perf","NodeId":"-281","OutputType":null}],"UsePreviousResults":false,"moduleIdForCode":1,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-285","ModuleId":"BigQuantSpace.dl_convert_to_bin.dl_convert_to_bin-v2","ModuleParameters":[{"Name":"window_size","Value":"50","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"feature_clip","Value":5,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"flatten","Value":"False","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"window_along_col","Value":"instrument","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_data","NodeId":"-285"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"features","NodeId":"-285"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-285","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":25,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true},{"Id":"-293","ModuleId":"BigQuantSpace.dl_convert_to_bin.dl_convert_to_bin-v2","ModuleParameters":[{"Name":"window_size","Value":"50","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"feature_clip","Value":5,"ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"flatten","Value":"False","ValueType":"Literal","LinkedGlobalParameter":null},{"Name":"window_along_col","Value":"instrument","ValueType":"Literal","LinkedGlobalParameter":null}],"InputPortsInternal":[{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"input_data","NodeId":"-293"},{"DataSourceId":null,"TrainedModelId":null,"TransformModuleId":null,"Name":"features","NodeId":"-293"}],"OutputPortsInternal":[{"Name":"data","NodeId":"-293","OutputType":null}],"UsePreviousResults":true,"moduleIdForCode":27,"IsPartOfPartialRun":null,"Comment":"","CommentCollapsed":true}],"SerializedClientData":"<?xml version='1.0' encoding='utf-16'?><DataV1 xmlns:xsd='http://www.w3.org/2001/XMLSchema' xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance'><Meta /><NodePositions><NodePosition Node='-214' Position='791,762,200,200'/><NodePosition Node='-210' Position='-20,-256,200,200'/><NodePosition Node='-218' Position='280,67,200,200'/><NodePosition Node='-316' Position='89,485,200,200'/><NodePosition Node='-320' Position='332,586,200,200'/><NodePosition Node='-332' Position='550,695,200,200'/><NodePosition Node='-2295' Position='1054,-341,200,200'/><NodePosition Node='-259' Position='281,387,200,200'/><NodePosition Node='-14806' Position='279,211,200,200'/><NodePosition Node='-14834' Position='277,150,200,200'/><NodePosition Node='-14841' Position='284,302,200,200'/><NodePosition Node='-403' Position='279,-195,200,200'/><NodePosition Node='-408' Position='282,-107,200,200'/><NodePosition Node='-446' Position='278,-23,200,200'/><NodePosition Node='-1966' Position='715,-224,200,200'/><NodePosition Node='-2290' Position='710,-72,200,200'/><NodePosition Node='-2296' Position='710,52,200,200'/><NodePosition Node='-2300' Position='707,212,200,200'/><NodePosition Node='-2306' Position='1057,212,200,200'/><NodePosition Node='-616' Position='717,-346,200,200'/><NodePosition Node='-620' Position='423,-457,200,200'/><NodePosition Node='-692' Position='1045,-227,200,200'/><NodePosition Node='-281' Position='976,894,200,200'/><NodePosition Node='-285' Position='710,373,200,200'/><NodePosition Node='-293' Position='1060,372,200,200'/></NodePositions><NodeGroups /></DataV1>"},"IsDraft":true,"ParentExperimentId":null,"WebService":{"IsWebServiceExperiment":false,"Inputs":[],"Outputs":[],"Parameters":[{"Name":"交易日期","Value":"","ParameterDefinition":{"Name":"交易日期","FriendlyName":"交易日期","DefaultValue":"","ParameterType":"String","HasDefaultValue":true,"IsOptional":true,"ParameterRules":[],"HasRules":false,"MarkupType":0,"CredentialDescriptor":null}}],"WebServiceGroupId":null,"SerializedClientData":"<?xml version='1.0' encoding='utf-16'?><DataV1 xmlns:xsd='http://www.w3.org/2001/XMLSchema' xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance'><Meta /><NodePositions></NodePositions><NodeGroups /></DataV1>"},"DisableNodesUpdate":false,"Category":"user","Tags":[],"IsPartialRun":true}
    In [2]:
    # 本代码由可视化策略环境自动生成 ‎2019‎年‎11月‎29‎日‎ ‎16‎:‎39
    # 本代码单元只能在可视化模式下编辑。您也可以拷贝代码,粘贴到新建的代码单元或者策略,然后修改。
    
    
    # Python 代码入口函数,input_1/2/3 对应三个输入端,data_1/2/3 对应三个输出端
    def m23_run_bigquant_run(input_1, input_2, input_3):
        fields = ['open','high','low','close','volume']
        input_1_df = input_1.read_pickle()
        ins = input_1_df['instruments']
        start_date = input_1_df['start_date']
        end_date = input_1_df['end_date']
        df = D.history_data(ins, start_date, end_date, fields)     
        data_1 = DataSource.write_df(df)
        return Outputs(data_1=data_1, data_2=None, data_3=None)
    
    # 后处理函数,可选。输入是主函数的输出,可以在这里对数据做处理,或者返回更友好的outputs数据格式。此函数输出不会被缓存。
    def m23_post_run_bigquant_run(outputs):
        return outputs
    
    # Python 代码入口函数,input_1/2/3 对应三个输入端,data_1/2/3 对应三个输出端
    def m16_run_bigquant_run(input_1, input_2, input_3):
        input_ds = input_1
        df = input_ds.read_df()
        df['return'] = (df.close.shift(-5)/df.close - 1)
        df['label'] = np.where(df['return'] > 0, 1, 0)
        ds = DataSource.write_df(df[['date','instrument','label']])
        return Outputs(data_1=ds)
    
    
    # 后处理函数,可选。输入是主函数的输出,可以在这里对数据做处理,或者返回更友好的outputs数据格式。此函数输出不会被缓存。
    def m16_post_run_bigquant_run(outputs):
        return outputs
    
    # Python 代码入口函数,input_1/2/3 对应三个输入端,data_1/2/3 对应三个输出端
    def m2_run_bigquant_run(input_1, input_2, input_3):
        input_series = input_1
        input_df = input_2
        test_data = input_df.read_pickle()
        pred_label = input_series.read_pickle()
      
        pred_result = pred_label.reshape(pred_label.shape[0]) 
        dt = input_3.read_df()['date'][-1*len(pred_result):]
        pred_df = pd.Series(pred_result, index=dt)
        ds = DataSource.write_df(pred_df)
        
        pred_label = np.where(pred_label>0.5,1,0)
        labels = test_data['y']
        print('准确率%s'%(np.mean(pred_label==labels)))
        
        return Outputs(data_1=ds)
    
    # 后处理函数,可选。输入是主函数的输出,可以在这里对数据做处理,或者返回更友好的outputs数据格式。此函数输出不会被缓存。
    def m2_post_run_bigquant_run(outputs):
        return outputs
    
    # 回测引擎:初始化函数,只执行一次
    def m1_initialize_bigquant_run(context):
        # 加载预测数据
        context.prediction = context.options['data'].read_df()
    
        # 系统已经设置了默认的交易手续费和滑点,要修改手续费可使用如下函数
        context.set_commission(PerOrder(buy_cost=0.0003, sell_cost=0.0013, min_cost=5))
    # 回测引擎:每日数据处理函数,每天执行一次
    def m1_handle_data_bigquant_run(context, data):
        # 按日期过滤得到今日的预测数据
        try:
            prediction = context.prediction[data.current_dt.strftime('%Y-%m-%d')]
        except KeyError as e:
            return
        
        instrument = context.instruments[0]
        sid = context.symbol(instrument)
        cur_position = context.portfolio.positions[sid].amount
        
        # 交易逻辑
        if prediction > 0.7 and cur_position == 0:
            context.order_target_percent(context.symbol(instrument), 1)
            print(data.current_dt, '买入!')
            
        elif prediction < 0.5 and cur_position > 0:
            context.order_target_percent(context.symbol(instrument), 0)
            print(data.current_dt, '卖出!')
        
    # 回测引擎:准备数据,只执行一次
    def m1_prepare_bigquant_run(context):
        pass
    
    # 回测引擎:每个单位时间开始前调用一次,即每日开盘前调用一次。
    def m1_before_trading_start_bigquant_run(context, data):
        pass
    
    
    m3 = M.dl_layer_input.v1(
        shape='50,15',
        batch_shape='',
        dtype='float32',
        sparse=False,
        name=''
    )
    
    m13 = M.dl_layer_reshape.v1(
        inputs=m3.data,
        target_shape='50,15,1',
        name=''
    )
    
    m14 = M.dl_layer_conv2d.v1(
        inputs=m13.data,
        filters=32,
        kernel_size='3,5',
        strides='1,1',
        padding='valid',
        data_format='channels_last',
        dilation_rate='1,1',
        activation='relu',
        use_bias=True,
        kernel_initializer='glorot_uniform',
        bias_initializer='Zeros',
        kernel_regularizer='None',
        kernel_regularizer_l1=0,
        kernel_regularizer_l2=0,
        bias_regularizer='None',
        bias_regularizer_l1=0,
        bias_regularizer_l2=0,
        activity_regularizer='None',
        activity_regularizer_l1=0,
        activity_regularizer_l2=0,
        kernel_constraint='None',
        bias_constraint='None',
        name=''
    )
    
    m15 = M.dl_layer_reshape.v1(
        inputs=m14.data,
        target_shape='132,128',
        name=''
    )
    
    m4 = M.dl_layer_lstm.v1(
        inputs=m15.data,
        units=32,
        activation='tanh',
        recurrent_activation='hard_sigmoid',
        use_bias=True,
        kernel_initializer='glorot_uniform',
        recurrent_initializer='Orthogonal',
        bias_initializer='Ones',
        unit_forget_bias=True,
        kernel_regularizer='None',
        kernel_regularizer_l1=0,
        kernel_regularizer_l2=0,
        recurrent_regularizer='None',
        recurrent_regularizer_l1=0,
        recurrent_regularizer_l2=0,
        bias_regularizer='None',
        bias_regularizer_l1=0,
        bias_regularizer_l2=0,
        activity_regularizer='None',
        activity_regularizer_l1=0,
        activity_regularizer_l2=0,
        kernel_constraint='None',
        recurrent_constraint='None',
        bias_constraint='None',
        dropout=0,
        recurrent_dropout=0,
        return_sequences=False,
        implementation='0',
        name=''
    )
    
    m11 = M.dl_layer_dropout.v1(
        inputs=m4.data,
        rate=0.001,
        noise_shape='',
        name=''
    )
    
    m10 = M.dl_layer_dense.v1(
        inputs=m11.data,
        units=32,
        activation='tanh',
        use_bias=True,
        kernel_initializer='glorot_uniform',
        bias_initializer='Zeros',
        kernel_regularizer='None',
        kernel_regularizer_l1=0,
        kernel_regularizer_l2=0,
        bias_regularizer='None',
        bias_regularizer_l1=0,
        bias_regularizer_l2=0,
        activity_regularizer='None',
        activity_regularizer_l1=0,
        activity_regularizer_l2=0,
        kernel_constraint='None',
        bias_constraint='None',
        name=''
    )
    
    m12 = M.dl_layer_dropout.v1(
        inputs=m10.data,
        rate=0.001,
        noise_shape='',
        name=''
    )
    
    m9 = M.dl_layer_dense.v1(
        inputs=m12.data,
        units=1,
        activation='sigmoid',
        use_bias=True,
        kernel_initializer='glorot_uniform',
        bias_initializer='Zeros',
        kernel_regularizer='None',
        kernel_regularizer_l1=0,
        kernel_regularizer_l2=0,
        bias_regularizer='None',
        bias_regularizer_l1=0,
        bias_regularizer_l2=0,
        activity_regularizer='None',
        activity_regularizer_l1=0,
        activity_regularizer_l2=0,
        kernel_constraint='None',
        bias_constraint='None',
        name=''
    )
    
    m5 = M.dl_model_init.v1(
        inputs=m3.data,
        outputs=m9.data
    )
    
    m8 = M.input_features.v1(
        features="""(close/shift(close,1)-1)*10
    (high/shift(high,1)-1)*10
    (low/shift(low,1)-1)*10
    (open/shift(open,1)-1)*10
    (volume/shift(volume,1)-1)*10
    ta_ma(close, derive='golden_cross')
    ta_ma(close, derive='death_cross')
    ta_kdj(high, low, close, 20, 20, 20, 'golden_cross')
    ta_kdj(high, low, close, 80, 80, 80, 'death_cross')
    ta_macd(close,'golden_cross')
    ta_macd(close,'death_cross')
    ta_trix(close, derive='golden_cross')
    ta_trix(close, derive='death_cross')
    ta_adx(high, low, close, 14)
    ta_bbands_u(close, 14)
    """
    )
    
    m24 = M.instruments.v2(
        start_date='2005-01-01',
        end_date='2019-10-30',
        market='CN_STOCK_A',
        instrument_list='600699.SHA',
        max_count=0
    )
    
    m23 = M.cached.v3(
        input_1=m24.data,
        run=m23_run_bigquant_run,
        post_run=m23_post_run_bigquant_run,
        input_ports='',
        params='{}',
        output_ports=''
    )
    
    m16 = M.cached.v3(
        input_1=m23.data_1,
        run=m16_run_bigquant_run,
        post_run=m16_post_run_bigquant_run,
        input_ports='',
        params='{}',
        output_ports=''
    )
    
    m26 = M.derived_feature_extractor.v3(
        input_data=m23.data_1,
        features=m8.data,
        date_col='date',
        instrument_col='instrument',
        drop_na=False,
        remove_extra_columns=False,
        user_functions={}
    )
    
    m17 = M.join.v3(
        data1=m16.data_1,
        data2=m26.data,
        on='date,instrument',
        how='inner',
        sort=True
    )
    
    m18 = M.dropnan.v1(
        input_data=m17.data
    )
    
    m19 = M.filter.v3(
        input_data=m18.data,
        expr='date<\'2017-06-01\'',
        output_left_data=False
    )
    
    m25 = M.dl_convert_to_bin.v2(
        input_data=m19.data,
        features=m8.data,
        window_size=50,
        feature_clip=5,
        flatten=False,
        window_along_col='instrument'
    )
    
    m6 = M.dl_model_train.v1(
        input_model=m5.data,
        training_data=m25.data,
        optimizer='Adam',
        loss='binary_crossentropy',
        metrics='accuracy',
        batch_size=2048,
        epochs=3000,
        n_gpus=0,
        verbose='1:输出进度条记录'
    )
    
    m20 = M.filter.v3(
        input_data=m18.data,
        expr='date>\'2017-06-01\'',
        output_left_data=False
    )
    
    m27 = M.dl_convert_to_bin.v2(
        input_data=m20.data,
        features=m8.data,
        window_size=50,
        feature_clip=5,
        flatten=False,
        window_along_col='instrument'
    )
    
    m7 = M.dl_model_predict.v1(
        trained_model=m6.data,
        input_data=m27.data,
        batch_size=10240,
        n_gpus=0,
        verbose='2:每个epoch输出一行记录'
    )
    
    m2 = M.cached.v3(
        input_1=m7.data,
        input_2=m27.data,
        input_3=m20.data,
        run=m2_run_bigquant_run,
        post_run=m2_post_run_bigquant_run,
        input_ports='',
        params='{}',
        output_ports=''
    )
    
    m1 = M.trade.v4(
        instruments=m24.data,
        options_data=m2.data_1,
        start_date='2017-04-01',
        end_date='',
        initialize=m1_initialize_bigquant_run,
        handle_data=m1_handle_data_bigquant_run,
        prepare=m1_prepare_bigquant_run,
        before_trading_start=m1_before_trading_start_bigquant_run,
        volume_limit=0.025,
        order_price_field_buy='open',
        order_price_field_sell='close',
        capital_base=1000000,
        auto_cancel_non_tradable_orders=True,
        data_frequency='daily',
        price_type='真实价格',
        product_type='股票',
        plot_charts=True,
        backtest_only=False,
        benchmark=''
    )
    
    Epoch 1/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.7252 - acc: 0.4787
    Epoch 2/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6930 - acc: 0.5236
    Epoch 3/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.7060 - acc: 0.5209
    Epoch 4/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.7037 - acc: 0.5209
    Epoch 5/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.6941 - acc: 0.5205
    Epoch 6/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6924 - acc: 0.5186
    Epoch 7/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6966 - acc: 0.4826
    Epoch 8/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6980 - acc: 0.4791
    Epoch 9/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6953 - acc: 0.4791
    Epoch 10/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6924 - acc: 0.5201
    Epoch 11/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.6927 - acc: 0.5197
    Epoch 12/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.6937 - acc: 0.5229
    Epoch 13/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6941 - acc: 0.5225
    Epoch 14/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6925 - acc: 0.5236
    Epoch 15/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.6917 - acc: 0.5201
    Epoch 16/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.6918 - acc: 0.5236
    Epoch 17/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6919 - acc: 0.5205
    Epoch 18/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6914 - acc: 0.5221
    Epoch 19/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6914 - acc: 0.5213
    Epoch 20/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.6922 - acc: 0.5174
    Epoch 21/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6915 - acc: 0.5205
    Epoch 22/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6913 - acc: 0.5225
    Epoch 23/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6920 - acc: 0.5197
    Epoch 24/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6912 - acc: 0.5326
    Epoch 25/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6911 - acc: 0.5385
    Epoch 26/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6913 - acc: 0.5268
    Epoch 27/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6913 - acc: 0.5225
    Epoch 28/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6912 - acc: 0.5193
    Epoch 29/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6916 - acc: 0.5244
    Epoch 30/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6911 - acc: 0.5412
    Epoch 31/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6916 - acc: 0.5260
    Epoch 32/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6912 - acc: 0.5260
    Epoch 33/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6903 - acc: 0.5330
    Epoch 34/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6902 - acc: 0.5412
    Epoch 35/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6915 - acc: 0.5303
    Epoch 36/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6915 - acc: 0.5322
    Epoch 37/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6905 - acc: 0.5436
    Epoch 38/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6901 - acc: 0.5311
    Epoch 39/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6907 - acc: 0.5260
    Epoch 40/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6907 - acc: 0.5252
    Epoch 41/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6899 - acc: 0.5334
    Epoch 42/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6901 - acc: 0.5389
    Epoch 43/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6901 - acc: 0.5428
    Epoch 44/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.6902 - acc: 0.5311
    Epoch 45/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6903 - acc: 0.5307
    Epoch 46/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6891 - acc: 0.5338
    Epoch 47/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.6906 - acc: 0.5404
    Epoch 48/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6901 - acc: 0.5389
    Epoch 49/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6896 - acc: 0.5358
    Epoch 50/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6897 - acc: 0.5318
    Epoch 51/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6897 - acc: 0.5326
    Epoch 52/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6897 - acc: 0.5287
    Epoch 53/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.6901 - acc: 0.5354
    Epoch 54/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.6896 - acc: 0.5424
    Epoch 55/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6903 - acc: 0.5373
    Epoch 56/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6897 - acc: 0.5354
    Epoch 57/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6901 - acc: 0.5244
    Epoch 58/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6900 - acc: 0.5299
    Epoch 59/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6895 - acc: 0.5397
    Epoch 60/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6902 - acc: 0.5420
    Epoch 61/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6900 - acc: 0.5322
    Epoch 62/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6901 - acc: 0.5318
    Epoch 63/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6890 - acc: 0.5447
    Epoch 64/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6900 - acc: 0.5369
    Epoch 65/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6894 - acc: 0.5389
    Epoch 66/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6898 - acc: 0.5393
    Epoch 67/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6890 - acc: 0.5408
    Epoch 68/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6888 - acc: 0.5330
    Epoch 69/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6891 - acc: 0.5342
    Epoch 70/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6891 - acc: 0.5338
    Epoch 71/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6891 - acc: 0.5365
    Epoch 72/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6889 - acc: 0.5350
    Epoch 73/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6884 - acc: 0.5369
    Epoch 74/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6887 - acc: 0.5412
    Epoch 75/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6891 - acc: 0.5322
    Epoch 76/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6887 - acc: 0.5346
    Epoch 77/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6886 - acc: 0.5440
    Epoch 78/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6887 - acc: 0.5471
    Epoch 79/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6881 - acc: 0.5350
    Epoch 80/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6886 - acc: 0.5381
    Epoch 81/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6892 - acc: 0.5377
    Epoch 82/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6880 - acc: 0.5408
    Epoch 83/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6882 - acc: 0.5447
    Epoch 84/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6880 - acc: 0.5397
    Epoch 85/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6869 - acc: 0.5455
    Epoch 86/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6874 - acc: 0.5459
    Epoch 87/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6883 - acc: 0.5479
    Epoch 88/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6875 - acc: 0.5514
    Epoch 89/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6863 - acc: 0.5541
    Epoch 90/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6869 - acc: 0.5479
    Epoch 91/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6870 - acc: 0.5498
    Epoch 92/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6866 - acc: 0.5498
    Epoch 93/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6866 - acc: 0.5463
    Epoch 94/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6858 - acc: 0.5522
    Epoch 95/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.6855 - acc: 0.5561
    Epoch 96/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6866 - acc: 0.5459
    Epoch 97/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6865 - acc: 0.5447
    Epoch 98/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6861 - acc: 0.5526
    Epoch 99/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6848 - acc: 0.5557
    Epoch 100/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6867 - acc: 0.5338
    Epoch 101/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6837 - acc: 0.5553
    Epoch 102/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6860 - acc: 0.5440
    Epoch 103/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6843 - acc: 0.5596
    Epoch 104/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6846 - acc: 0.5588
    Epoch 105/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6840 - acc: 0.5655
    Epoch 106/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6833 - acc: 0.5569
    Epoch 107/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6829 - acc: 0.5553
    Epoch 108/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6837 - acc: 0.5510
    Epoch 109/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6844 - acc: 0.5612
    Epoch 110/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6838 - acc: 0.5506
    Epoch 111/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6844 - acc: 0.5428
    Epoch 112/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6838 - acc: 0.5455
    Epoch 113/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.6822 - acc: 0.5619
    Epoch 114/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6825 - acc: 0.5576
    Epoch 115/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6819 - acc: 0.5678
    Epoch 116/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6817 - acc: 0.5588
    Epoch 117/3000
    2559/2559 [==============================] - 24s 10ms/step - loss: 0.6806 - acc: 0.5647
    Epoch 118/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6794 - acc: 0.5655
    Epoch 119/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 0.6797 - acc: 0.5592
    Epoch 120/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6787 - acc: 0.5569
    Epoch 121/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6782 - acc: 0.5690
    Epoch 122/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6792 - acc: 0.5651
    Epoch 123/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6778 - acc: 0.5635
    Epoch 124/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6816 - acc: 0.5604
    Epoch 125/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6770 - acc: 0.5729
    Epoch 126/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6791 - acc: 0.5651
    Epoch 127/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6763 - acc: 0.5701
    Epoch 128/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6764 - acc: 0.5772
    Epoch 129/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6754 - acc: 0.5764
    Epoch 130/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6746 - acc: 0.5776
    Epoch 131/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6752 - acc: 0.5772
    Epoch 132/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6730 - acc: 0.5768
    Epoch 133/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6725 - acc: 0.5803
    Epoch 134/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6738 - acc: 0.5846
    Epoch 135/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6738 - acc: 0.5756
    Epoch 136/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6754 - acc: 0.5721
    Epoch 137/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6730 - acc: 0.5748
    Epoch 138/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6738 - acc: 0.5784
    Epoch 139/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6704 - acc: 0.5838
    Epoch 140/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6675 - acc: 0.5983
    Epoch 141/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6705 - acc: 0.5842
    Epoch 142/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6690 - acc: 0.5846
    Epoch 143/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6707 - acc: 0.5846
    Epoch 144/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6685 - acc: 0.5854
    Epoch 145/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6669 - acc: 0.5959
    Epoch 146/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6653 - acc: 0.5998
    Epoch 147/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6662 - acc: 0.5862
    Epoch 148/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6652 - acc: 0.5905
    Epoch 149/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6635 - acc: 0.6030
    Epoch 150/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6646 - acc: 0.6006
    Epoch 151/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6650 - acc: 0.5901
    Epoch 152/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6606 - acc: 0.6041
    Epoch 153/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6672 - acc: 0.5983
    Epoch 154/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6627 - acc: 0.6069
    Epoch 155/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6630 - acc: 0.5893
    Epoch 156/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6662 - acc: 0.5893
    Epoch 157/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6601 - acc: 0.6100
    Epoch 158/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6648 - acc: 0.5959
    Epoch 159/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6598 - acc: 0.6084
    Epoch 160/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6569 - acc: 0.6116
    Epoch 161/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6615 - acc: 0.5940
    Epoch 162/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6566 - acc: 0.6088
    Epoch 163/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6545 - acc: 0.6194
    Epoch 164/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6540 - acc: 0.6151
    Epoch 165/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6527 - acc: 0.6225
    Epoch 166/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6521 - acc: 0.6198
    Epoch 167/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6517 - acc: 0.6182
    Epoch 168/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6510 - acc: 0.6221
    Epoch 169/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6500 - acc: 0.6194
    Epoch 170/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6491 - acc: 0.6276
    Epoch 171/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6474 - acc: 0.6241
    Epoch 172/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6492 - acc: 0.6241
    Epoch 173/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6510 - acc: 0.6280
    Epoch 174/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6455 - acc: 0.6323
    Epoch 175/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6477 - acc: 0.6323
    Epoch 176/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6446 - acc: 0.6268
    Epoch 177/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6433 - acc: 0.6272
    Epoch 178/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6427 - acc: 0.6303
    Epoch 179/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6425 - acc: 0.6335
    Epoch 180/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6415 - acc: 0.6315
    Epoch 181/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6434 - acc: 0.6370
    Epoch 182/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6412 - acc: 0.6350
    Epoch 183/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6396 - acc: 0.6377
    Epoch 184/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6368 - acc: 0.6420
    Epoch 185/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6414 - acc: 0.6405
    Epoch 186/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6414 - acc: 0.6268
    Epoch 187/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6428 - acc: 0.6327
    Epoch 188/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6351 - acc: 0.6374
    Epoch 189/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6406 - acc: 0.6327
    Epoch 190/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6393 - acc: 0.6354
    Epoch 191/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6333 - acc: 0.6479
    Epoch 192/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6359 - acc: 0.6393
    Epoch 193/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6288 - acc: 0.6471
    Epoch 194/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6299 - acc: 0.6456
    Epoch 195/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6271 - acc: 0.6503
    Epoch 196/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6281 - acc: 0.6499
    Epoch 197/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6250 - acc: 0.6503
    Epoch 198/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6255 - acc: 0.6463
    Epoch 199/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 0.6245 - acc: 0.6452
    Epoch 200/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6314 - acc: 0.6456
    Epoch 201/3000
    2559/2559 [==============================] - 46s 18ms/step - loss: 0.6282 - acc: 0.6397
    Epoch 202/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6201 - acc: 0.6514
    Epoch 203/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6206 - acc: 0.6573
    Epoch 204/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.6264 - acc: 0.6377
    Epoch 205/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6257 - acc: 0.6385
    Epoch 206/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6250 - acc: 0.6546
    Epoch 207/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6317 - acc: 0.6338
    Epoch 208/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6192 - acc: 0.6549
    Epoch 209/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6386 - acc: 0.6241
    Epoch 210/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6206 - acc: 0.6608
    Epoch 211/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6219 - acc: 0.6518
    Epoch 212/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6203 - acc: 0.6534
    Epoch 213/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.6272 - acc: 0.6479
    Epoch 214/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6189 - acc: 0.6620
    Epoch 215/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6223 - acc: 0.6420
    Epoch 216/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6170 - acc: 0.6592
    Epoch 217/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6168 - acc: 0.6620
    Epoch 218/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.6131 - acc: 0.6635
    Epoch 219/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.6093 - acc: 0.6647
    Epoch 220/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.6108 - acc: 0.6600
    Epoch 221/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6063 - acc: 0.6647
    Epoch 222/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.6023 - acc: 0.6729
    Epoch 223/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.6009 - acc: 0.6729
    Epoch 224/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6006 - acc: 0.6753
    Epoch 225/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.5964 - acc: 0.6827
    Epoch 226/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5960 - acc: 0.6792
    Epoch 227/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.5927 - acc: 0.6839
    Epoch 228/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5919 - acc: 0.6878
    Epoch 229/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.5888 - acc: 0.6886
    Epoch 230/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5975 - acc: 0.6682
    Epoch 231/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.5938 - acc: 0.6889
    Epoch 232/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.5820 - acc: 0.6944
    Epoch 233/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5856 - acc: 0.6878
    Epoch 234/3000
    2559/2559 [==============================] - 29s 11ms/step - loss: 0.5880 - acc: 0.6921
    Epoch 235/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.5879 - acc: 0.6846
    Epoch 236/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5978 - acc: 0.6760
    Epoch 237/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5890 - acc: 0.6784
    Epoch 238/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.5935 - acc: 0.6886
    Epoch 239/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5936 - acc: 0.6792
    Epoch 240/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.5841 - acc: 0.6917
    Epoch 241/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.5977 - acc: 0.6780
    Epoch 242/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.5777 - acc: 0.7018
    Epoch 243/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.5951 - acc: 0.6714
    Epoch 244/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5672 - acc: 0.7100
    Epoch 245/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5980 - acc: 0.6757
    Epoch 246/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.5767 - acc: 0.6960
    Epoch 247/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5793 - acc: 0.6987
    Epoch 248/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5760 - acc: 0.6983
    Epoch 249/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5648 - acc: 0.7007
    Epoch 250/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5725 - acc: 0.7022
    Epoch 251/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.5638 - acc: 0.7182
    Epoch 252/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5603 - acc: 0.7233
    Epoch 253/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5625 - acc: 0.7100
    Epoch 254/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5591 - acc: 0.7163
    Epoch 255/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.5522 - acc: 0.7308
    Epoch 256/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5497 - acc: 0.7280
    Epoch 257/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.5514 - acc: 0.7268
    Epoch 258/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5483 - acc: 0.7276
    Epoch 259/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5463 - acc: 0.7296
    Epoch 260/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 0.5454 - acc: 0.7304
    Epoch 261/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.5408 - acc: 0.7304
    Epoch 262/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5486 - acc: 0.7206
    Epoch 263/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5394 - acc: 0.7358
    Epoch 264/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5324 - acc: 0.7366
    Epoch 265/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.5291 - acc: 0.7444
    Epoch 266/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.5292 - acc: 0.7468
    Epoch 267/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.5307 - acc: 0.7362
    Epoch 268/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.5237 - acc: 0.7394
    Epoch 269/3000
    2559/2559 [==============================] - 28s 11ms/step - loss: 0.5234 - acc: 0.7487
    Epoch 270/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.5197 - acc: 0.7444
    Epoch 271/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5155 - acc: 0.7526
    Epoch 272/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.5142 - acc: 0.7597
    Epoch 273/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.5128 - acc: 0.7515
    Epoch 274/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.5067 - acc: 0.7612
    Epoch 275/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.5174 - acc: 0.7448
    Epoch 276/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.5287 - acc: 0.7394
    Epoch 277/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.5178 - acc: 0.7417
    Epoch 278/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.5127 - acc: 0.7476
    Epoch 279/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.5077 - acc: 0.7538
    Epoch 280/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5219 - acc: 0.7417
    Epoch 281/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5441 - acc: 0.7136
    Epoch 282/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.5207 - acc: 0.7374
    Epoch 283/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.5113 - acc: 0.7495
    Epoch 284/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.5302 - acc: 0.7374
    Epoch 285/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.5032 - acc: 0.7589
    Epoch 286/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.5192 - acc: 0.7456
    Epoch 287/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.5059 - acc: 0.7589
    Epoch 288/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.5014 - acc: 0.7569
    Epoch 289/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.5034 - acc: 0.7620
    Epoch 290/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.4965 - acc: 0.7636
    Epoch 291/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.4926 - acc: 0.7581
    Epoch 292/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.4779 - acc: 0.7773
    Epoch 293/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.4896 - acc: 0.7636
    Epoch 294/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 0.4742 - acc: 0.7784
    Epoch 295/3000
    2559/2559 [==============================] - 27s 11ms/step - loss: 0.4674 - acc: 0.7831
    Epoch 296/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.4678 - acc: 0.7816
    Epoch 297/3000
    2559/2559 [==============================] - 24s 10ms/step - loss: 0.4615 - acc: 0.7812
    Epoch 298/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.4560 - acc: 0.7960
    Epoch 299/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.4604 - acc: 0.7882
    Epoch 300/3000
    2559/2559 [==============================] - 27s 11ms/step - loss: 0.4482 - acc: 0.7917
    Epoch 301/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.4544 - acc: 0.7851
    Epoch 302/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.4504 - acc: 0.7937
    Epoch 303/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.4563 - acc: 0.7874
    Epoch 304/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.4468 - acc: 0.7968
    Epoch 305/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.4496 - acc: 0.7843
    Epoch 306/3000
    2559/2559 [==============================] - 27s 10ms/step - loss: 0.4515 - acc: 0.7937
    Epoch 307/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.4532 - acc: 0.7847
    Epoch 308/3000
    2559/2559 [==============================] - 29s 11ms/step - loss: 0.4333 - acc: 0.7972
    Epoch 309/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.4329 - acc: 0.7991
    Epoch 310/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.4284 - acc: 0.8073
    Epoch 311/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.4279 - acc: 0.8093
    Epoch 312/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.4253 - acc: 0.8113
    Epoch 313/3000
    2559/2559 [==============================] - 24s 10ms/step - loss: 0.4254 - acc: 0.8015
    Epoch 314/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.4169 - acc: 0.8124
    Epoch 315/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.4209 - acc: 0.8116
    Epoch 316/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.4234 - acc: 0.8105
    Epoch 317/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.4183 - acc: 0.8046
    Epoch 318/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.4095 - acc: 0.8136
    Epoch 319/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.4251 - acc: 0.8019
    Epoch 320/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.4192 - acc: 0.8038
    Epoch 321/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.4091 - acc: 0.8167
    Epoch 322/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.4044 - acc: 0.8163
    Epoch 323/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.4181 - acc: 0.8113
    Epoch 324/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.4002 - acc: 0.8167
    Epoch 325/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.3989 - acc: 0.8191
    Epoch 326/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.3891 - acc: 0.8234
    Epoch 327/3000
    2559/2559 [==============================] - 24s 10ms/step - loss: 0.4099 - acc: 0.8116
    Epoch 328/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.3921 - acc: 0.8288
    Epoch 329/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.4019 - acc: 0.8195
    Epoch 330/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.3878 - acc: 0.8257
    Epoch 331/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.3768 - acc: 0.8335
    Epoch 332/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.3688 - acc: 0.8370
    Epoch 333/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.3758 - acc: 0.8378
    Epoch 334/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.3630 - acc: 0.8398
    Epoch 335/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.3833 - acc: 0.8304
    Epoch 336/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.3795 - acc: 0.8355
    Epoch 337/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 0.3742 - acc: 0.8312
    Epoch 338/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.3620 - acc: 0.8359
    Epoch 339/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.3608 - acc: 0.8374
    Epoch 340/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.3730 - acc: 0.8347
    Epoch 341/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.3523 - acc: 0.8390
    Epoch 342/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.3709 - acc: 0.8374
    Epoch 343/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 0.3490 - acc: 0.8492
    Epoch 344/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3435 - acc: 0.8499
    Epoch 345/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.3349 - acc: 0.8621
    Epoch 346/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.3377 - acc: 0.8609
    Epoch 347/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.3414 - acc: 0.8492
    Epoch 348/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.3409 - acc: 0.8578
    Epoch 349/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.3346 - acc: 0.8558
    Epoch 350/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.3218 - acc: 0.8585
    Epoch 351/3000
    2559/2559 [==============================] - 28s 11ms/step - loss: 0.3360 - acc: 0.8554
    Epoch 352/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3263 - acc: 0.8601
    Epoch 353/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3249 - acc: 0.8593
    Epoch 354/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.3454 - acc: 0.8476
    Epoch 355/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.3346 - acc: 0.8558
    Epoch 356/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.3558 - acc: 0.8382
    Epoch 357/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.3386 - acc: 0.8554
    Epoch 358/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3499 - acc: 0.8449
    Epoch 359/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3239 - acc: 0.8601
    Epoch 360/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.3249 - acc: 0.8605
    Epoch 361/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3576 - acc: 0.8410
    Epoch 362/3000
    2559/2559 [==============================] - 29s 11ms/step - loss: 0.3183 - acc: 0.8624
    Epoch 363/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.3641 - acc: 0.8359
    Epoch 364/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3403 - acc: 0.8546
    Epoch 365/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.3209 - acc: 0.8589
    Epoch 366/3000
    2559/2559 [==============================] - 30s 12ms/step - loss: 0.3422 - acc: 0.8488
    Epoch 367/3000
    2559/2559 [==============================] - 24s 10ms/step - loss: 0.3306 - acc: 0.8581
    Epoch 368/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.3225 - acc: 0.8597
    Epoch 369/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.3146 - acc: 0.8714
    Epoch 370/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3271 - acc: 0.8566
    Epoch 371/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.2982 - acc: 0.8757
    Epoch 372/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3009 - acc: 0.8773
    Epoch 373/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3032 - acc: 0.8675
    Epoch 374/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3034 - acc: 0.8703
    Epoch 375/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.2890 - acc: 0.8789
    Epoch 376/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3148 - acc: 0.8640
    Epoch 377/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.2895 - acc: 0.8820
    Epoch 378/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.2774 - acc: 0.8894
    Epoch 379/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.2698 - acc: 0.8890
    Epoch 380/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.2612 - acc: 0.8961
    Epoch 381/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.2680 - acc: 0.8953
    Epoch 382/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.2566 - acc: 0.8953
    Epoch 383/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.2544 - acc: 0.9000
    Epoch 384/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2551 - acc: 0.8945
    Epoch 385/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2507 - acc: 0.8929
    Epoch 386/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2507 - acc: 0.9015
    Epoch 387/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.2584 - acc: 0.8976
    Epoch 388/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2624 - acc: 0.9004
    Epoch 389/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.2549 - acc: 0.9004
    Epoch 390/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.2491 - acc: 0.8964
    Epoch 391/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.2398 - acc: 0.9089
    Epoch 392/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.2379 - acc: 0.9039
    Epoch 393/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.2379 - acc: 0.9054
    Epoch 394/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.2481 - acc: 0.9023
    Epoch 395/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.2365 - acc: 0.9027
    Epoch 396/3000
    2559/2559 [==============================] - 29s 11ms/step - loss: 0.2322 - acc: 0.9105
    Epoch 397/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.2365 - acc: 0.9070
    Epoch 398/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.2471 - acc: 0.8992
    Epoch 399/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2353 - acc: 0.9070
    Epoch 400/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2407 - acc: 0.9031
    Epoch 401/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2236 - acc: 0.9140
    Epoch 402/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.2291 - acc: 0.9109
    Epoch 403/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2229 - acc: 0.9105
    Epoch 404/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.2191 - acc: 0.9179
    Epoch 405/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2265 - acc: 0.9113
    Epoch 406/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2330 - acc: 0.9097
    Epoch 407/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2170 - acc: 0.9156
    Epoch 408/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.2341 - acc: 0.9066
    Epoch 409/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2431 - acc: 0.8953
    Epoch 410/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2057 - acc: 0.9258
    Epoch 411/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2123 - acc: 0.9199
    Epoch 412/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2173 - acc: 0.9148
    Epoch 413/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1995 - acc: 0.9269
    Epoch 414/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2052 - acc: 0.9215
    Epoch 415/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.2060 - acc: 0.9207
    Epoch 416/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1939 - acc: 0.9289
    Epoch 417/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2045 - acc: 0.9226
    Epoch 418/3000
    2559/2559 [==============================] - 24s 10ms/step - loss: 0.1934 - acc: 0.9273
    Epoch 419/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1983 - acc: 0.9261
    Epoch 420/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.1944 - acc: 0.9304
    Epoch 421/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.1912 - acc: 0.9308
    Epoch 422/3000
    2559/2559 [==============================] - 28s 11ms/step - loss: 0.1903 - acc: 0.9320
    Epoch 423/3000
    2559/2559 [==============================] - 27s 11ms/step - loss: 0.1958 - acc: 0.9254
    Epoch 424/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.1842 - acc: 0.9394
    Epoch 425/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2034 - acc: 0.9203
    Epoch 426/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1909 - acc: 0.9301
    Epoch 427/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.1865 - acc: 0.9281
    Epoch 428/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1724 - acc: 0.9367
    Epoch 429/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1739 - acc: 0.9379
    Epoch 430/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1823 - acc: 0.9328
    Epoch 431/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1926 - acc: 0.9269
    Epoch 432/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2572 - acc: 0.8882
    Epoch 433/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2170 - acc: 0.9156
    Epoch 434/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2223 - acc: 0.9066
    Epoch 435/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.2102 - acc: 0.9172
    Epoch 436/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.2479 - acc: 0.8964
    Epoch 437/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.2710 - acc: 0.8812
    Epoch 438/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.2230 - acc: 0.9109
    Epoch 439/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2120 - acc: 0.9140
    Epoch 440/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.2188 - acc: 0.9140
    Epoch 441/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2070 - acc: 0.9195
    Epoch 442/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1948 - acc: 0.9258
    Epoch 443/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1978 - acc: 0.9234
    Epoch 444/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.2241 - acc: 0.9031
    Epoch 445/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.2035 - acc: 0.9172
    Epoch 446/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.2347 - acc: 0.9078
    Epoch 447/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.2254 - acc: 0.9066
    Epoch 448/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2060 - acc: 0.9203
    Epoch 449/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1895 - acc: 0.9285
    Epoch 450/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.2014 - acc: 0.9234
    Epoch 451/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1953 - acc: 0.9234
    Epoch 452/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1680 - acc: 0.9422
    Epoch 453/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1963 - acc: 0.9261
    Epoch 454/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1714 - acc: 0.9402
    Epoch 455/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2014 - acc: 0.9187
    Epoch 456/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1692 - acc: 0.9390
    Epoch 457/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1641 - acc: 0.9422
    Epoch 458/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1553 - acc: 0.9480
    Epoch 459/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1580 - acc: 0.9457
    Epoch 460/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.1484 - acc: 0.9512
    Epoch 461/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1519 - acc: 0.9457
    Epoch 462/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.1425 - acc: 0.9523
    Epoch 463/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1465 - acc: 0.9492
    Epoch 464/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1389 - acc: 0.9586
    Epoch 465/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1346 - acc: 0.9613
    Epoch 466/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.1277 - acc: 0.9613
    Epoch 467/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1312 - acc: 0.9605
    Epoch 468/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.1251 - acc: 0.9621
    Epoch 469/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1195 - acc: 0.9668
    Epoch 470/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.1241 - acc: 0.9629
    Epoch 471/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1170 - acc: 0.9656
    Epoch 472/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1225 - acc: 0.9660
    Epoch 473/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1313 - acc: 0.9582
    Epoch 474/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1125 - acc: 0.9668
    Epoch 475/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.1096 - acc: 0.9691
    Epoch 476/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.1063 - acc: 0.9707
    Epoch 477/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1073 - acc: 0.9723
    Epoch 478/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.1060 - acc: 0.9738
    Epoch 479/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.1036 - acc: 0.9738
    Epoch 480/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1016 - acc: 0.9777
    Epoch 481/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.1010 - acc: 0.9754
    Epoch 482/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.1018 - acc: 0.9769
    Epoch 483/3000
    2559/2559 [==============================] - 24s 10ms/step - loss: 0.0972 - acc: 0.9769
    Epoch 484/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1082 - acc: 0.9711
    Epoch 485/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.1116 - acc: 0.9637
    Epoch 486/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1081 - acc: 0.9672
    Epoch 487/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1090 - acc: 0.9664
    Epoch 488/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.1025 - acc: 0.9734
    Epoch 489/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1132 - acc: 0.9656
    Epoch 490/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0991 - acc: 0.9754
    Epoch 491/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1007 - acc: 0.9723
    Epoch 492/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0993 - acc: 0.9707
    Epoch 493/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1002 - acc: 0.9715
    Epoch 494/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1026 - acc: 0.9738
    Epoch 495/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1061 - acc: 0.9703
    Epoch 496/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1727 - acc: 0.9336
    Epoch 497/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.2108 - acc: 0.9156
    Epoch 498/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1916 - acc: 0.9226
    Epoch 499/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1493 - acc: 0.9469
    Epoch 500/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1292 - acc: 0.9527
    Epoch 501/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1427 - acc: 0.9480
    Epoch 502/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1434 - acc: 0.9492
    Epoch 503/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1173 - acc: 0.9625
    Epoch 504/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1287 - acc: 0.9558
    Epoch 505/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1254 - acc: 0.9555
    Epoch 506/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1234 - acc: 0.9621
    Epoch 507/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1244 - acc: 0.9578
    Epoch 508/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0997 - acc: 0.9746
    Epoch 509/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0988 - acc: 0.9715
    Epoch 510/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0936 - acc: 0.9742
    Epoch 511/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0932 - acc: 0.9750
    Epoch 512/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0875 - acc: 0.9777
    Epoch 513/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0822 - acc: 0.9820
    Epoch 514/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0920 - acc: 0.9723
    Epoch 515/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1018 - acc: 0.9683
    Epoch 516/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0828 - acc: 0.9812
    Epoch 517/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0813 - acc: 0.9801
    Epoch 518/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0885 - acc: 0.9707
    Epoch 519/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0809 - acc: 0.9789
    Epoch 520/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0770 - acc: 0.9801
    Epoch 521/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0750 - acc: 0.9820
    Epoch 522/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0733 - acc: 0.9828
    Epoch 523/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0724 - acc: 0.9859
    Epoch 524/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0666 - acc: 0.9863
    Epoch 525/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0649 - acc: 0.9875
    Epoch 526/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0634 - acc: 0.9879
    Epoch 527/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0642 - acc: 0.9867
    Epoch 528/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0617 - acc: 0.9883
    Epoch 529/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0601 - acc: 0.9894
    Epoch 530/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0603 - acc: 0.9891
    Epoch 531/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0579 - acc: 0.9891
    Epoch 532/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0564 - acc: 0.9902
    Epoch 533/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.0549 - acc: 0.9918
    Epoch 534/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0556 - acc: 0.9902
    Epoch 535/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.0543 - acc: 0.9910
    Epoch 536/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0538 - acc: 0.9910
    Epoch 537/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0521 - acc: 0.9926
    Epoch 538/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0530 - acc: 0.9918
    Epoch 539/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0500 - acc: 0.9914
    Epoch 540/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0535 - acc: 0.9922
    Epoch 541/3000
    2559/2559 [==============================] - 27s 10ms/step - loss: 0.0581 - acc: 0.9875
    Epoch 542/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0539 - acc: 0.9898
    Epoch 543/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0505 - acc: 0.9910
    Epoch 544/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0523 - acc: 0.9902
    Epoch 545/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0474 - acc: 0.9930
    Epoch 546/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0477 - acc: 0.9934
    Epoch 547/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0477 - acc: 0.9926
    Epoch 548/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0475 - acc: 0.9922
    Epoch 549/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0464 - acc: 0.9914
    Epoch 550/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0455 - acc: 0.9926
    Epoch 551/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0496 - acc: 0.9922
    Epoch 552/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0499 - acc: 0.9922
    Epoch 553/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0702 - acc: 0.9805
    Epoch 554/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0564 - acc: 0.9894
    Epoch 555/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0732 - acc: 0.9809
    Epoch 556/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0610 - acc: 0.9852
    Epoch 557/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0601 - acc: 0.9871
    Epoch 558/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0620 - acc: 0.9848
    Epoch 559/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0550 - acc: 0.9887
    Epoch 560/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0544 - acc: 0.9898
    Epoch 561/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0587 - acc: 0.9875
    Epoch 562/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0589 - acc: 0.9875
    Epoch 563/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0550 - acc: 0.9879
    Epoch 564/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0525 - acc: 0.9918
    Epoch 565/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0573 - acc: 0.9879
    Epoch 566/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0558 - acc: 0.9871
    Epoch 567/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0596 - acc: 0.9891
    Epoch 568/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0645 - acc: 0.9828
    Epoch 569/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0774 - acc: 0.9793
    Epoch 570/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0718 - acc: 0.9777
    Epoch 571/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1368 - acc: 0.9469
    Epoch 572/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.2237 - acc: 0.9211
    Epoch 573/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.2001 - acc: 0.9289
    Epoch 574/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2355 - acc: 0.9191
    Epoch 575/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1977 - acc: 0.9308
    Epoch 576/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1763 - acc: 0.9343
    Epoch 577/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1349 - acc: 0.9469
    Epoch 578/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1373 - acc: 0.9453
    Epoch 579/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1397 - acc: 0.9418
    Epoch 580/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1266 - acc: 0.9547
    Epoch 581/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1127 - acc: 0.9578
    Epoch 582/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1117 - acc: 0.9566
    Epoch 583/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1103 - acc: 0.9597
    Epoch 584/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0798 - acc: 0.9762
    Epoch 585/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0815 - acc: 0.9734
    Epoch 586/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0717 - acc: 0.9777
    Epoch 587/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0728 - acc: 0.9773
    Epoch 588/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0632 - acc: 0.9852
    Epoch 589/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0622 - acc: 0.9836
    Epoch 590/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0607 - acc: 0.9863
    Epoch 591/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0542 - acc: 0.9898
    Epoch 592/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0485 - acc: 0.9914
    Epoch 593/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0536 - acc: 0.9898
    Epoch 594/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0459 - acc: 0.9910
    Epoch 595/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0474 - acc: 0.9914
    Epoch 596/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0413 - acc: 0.9945
    Epoch 597/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0406 - acc: 0.9937
    Epoch 598/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0407 - acc: 0.9937
    Epoch 599/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0366 - acc: 0.9961
    Epoch 600/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0379 - acc: 0.9945
    Epoch 601/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0373 - acc: 0.9945
    Epoch 602/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0350 - acc: 0.9953
    Epoch 603/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.0346 - acc: 0.9949
    Epoch 604/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0331 - acc: 0.9949
    Epoch 605/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0335 - acc: 0.9961
    Epoch 606/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0325 - acc: 0.9949
    Epoch 607/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0315 - acc: 0.9965
    Epoch 608/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0320 - acc: 0.9965
    Epoch 609/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0304 - acc: 0.9969
    Epoch 610/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0305 - acc: 0.9961
    Epoch 611/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0298 - acc: 0.9965
    Epoch 612/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0296 - acc: 0.9957
    Epoch 613/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0303 - acc: 0.9949
    Epoch 614/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0293 - acc: 0.9969
    Epoch 615/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0278 - acc: 0.9977
    Epoch 616/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0302 - acc: 0.9949
    Epoch 617/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0300 - acc: 0.9957
    Epoch 618/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0278 - acc: 0.9965
    Epoch 619/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0288 - acc: 0.9957
    Epoch 620/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0262 - acc: 0.9969
    Epoch 621/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0263 - acc: 0.9969
    Epoch 622/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0286 - acc: 0.9965
    Epoch 623/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0264 - acc: 0.9973
    Epoch 624/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0269 - acc: 0.9973
    Epoch 625/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0276 - acc: 0.9957
    Epoch 626/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0260 - acc: 0.9965
    Epoch 627/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.0263 - acc: 0.9965
    Epoch 628/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0254 - acc: 0.9977
    Epoch 629/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0246 - acc: 0.9973
    Epoch 630/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0243 - acc: 0.9980
    Epoch 631/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0254 - acc: 0.9973
    Epoch 632/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0246 - acc: 0.9973
    Epoch 633/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0234 - acc: 0.9977
    Epoch 634/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0230 - acc: 0.9980
    Epoch 635/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0237 - acc: 0.9973
    Epoch 636/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0229 - acc: 0.9980
    Epoch 637/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0223 - acc: 0.9988
    Epoch 638/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0220 - acc: 0.9984
    Epoch 639/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0222 - acc: 0.9988
    Epoch 640/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0216 - acc: 0.9988
    Epoch 641/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0211 - acc: 0.9988
    Epoch 642/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0227 - acc: 0.9977
    Epoch 643/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0231 - acc: 0.9980
    Epoch 644/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0222 - acc: 0.9973
    Epoch 645/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0207 - acc: 0.9988
    Epoch 646/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0220 - acc: 0.9977
    Epoch 647/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0204 - acc: 0.9988
    Epoch 648/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0211 - acc: 0.9992
    Epoch 649/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0221 - acc: 0.9984
    Epoch 650/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0209 - acc: 0.9988
    Epoch 651/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0213 - acc: 0.9984
    Epoch 652/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0194 - acc: 0.9992
    Epoch 653/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0194 - acc: 0.9988
    Epoch 654/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0193 - acc: 0.9988
    Epoch 655/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0213 - acc: 0.9984
    Epoch 656/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0193 - acc: 0.9988
    Epoch 657/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0194 - acc: 0.9988
    Epoch 658/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0187 - acc: 0.9988
    Epoch 659/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0183 - acc: 0.9992
    Epoch 660/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0185 - acc: 0.9988
    Epoch 661/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0181 - acc: 0.9992
    Epoch 662/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0188 - acc: 0.9984
    Epoch 663/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0177 - acc: 0.9988
    Epoch 664/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0176 - acc: 0.9988
    Epoch 665/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0177 - acc: 0.9988
    Epoch 666/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0170 - acc: 0.9992
    Epoch 667/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0194 - acc: 0.9984
    Epoch 668/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0177 - acc: 0.9988
    Epoch 669/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0174 - acc: 0.9988
    Epoch 670/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0174 - acc: 0.9988
    Epoch 671/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0179 - acc: 0.9988
    Epoch 672/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0196 - acc: 0.9980
    Epoch 673/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0180 - acc: 0.9988
    Epoch 674/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0260 - acc: 0.9977
    Epoch 675/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0179 - acc: 0.9992
    Epoch 676/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0195 - acc: 0.9992
    Epoch 677/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0194 - acc: 0.9984
    Epoch 678/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0198 - acc: 0.9988
    Epoch 679/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0210 - acc: 0.9988
    Epoch 680/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0206 - acc: 0.9988
    Epoch 681/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0207 - acc: 0.9980
    Epoch 682/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0206 - acc: 0.9984
    Epoch 683/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0192 - acc: 0.9984
    Epoch 684/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0220 - acc: 0.9984
    Epoch 685/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0192 - acc: 0.9977
    Epoch 686/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.0182 - acc: 0.9980
    Epoch 687/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 0.0173 - acc: 0.9992
    Epoch 688/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0165 - acc: 0.9992
    Epoch 689/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.0174 - acc: 0.9992
    Epoch 690/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0168 - acc: 0.9992
    Epoch 691/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0160 - acc: 0.9988
    Epoch 692/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0166 - acc: 0.9988
    Epoch 693/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0172 - acc: 0.9984
    Epoch 694/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0157 - acc: 0.9984
    Epoch 695/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0157 - acc: 0.9984
    Epoch 696/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0145 - acc: 0.9992
    Epoch 697/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0147 - acc: 0.9988
    Epoch 698/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0150 - acc: 0.9984
    Epoch 699/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0148 - acc: 0.9988
    Epoch 700/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0143 - acc: 0.9988
    Epoch 701/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0150 - acc: 0.9988
    Epoch 702/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0140 - acc: 0.9992
    Epoch 703/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0148 - acc: 0.9984
    Epoch 704/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.0144 - acc: 0.9988
    Epoch 705/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0121 - acc: 0.9992
    Epoch 706/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0150 - acc: 0.9984
    Epoch 707/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0132 - acc: 0.9992
    Epoch 708/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0141 - acc: 0.9988
    Epoch 709/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0134 - acc: 0.9988
    Epoch 710/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0138 - acc: 0.9984
    Epoch 711/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0148 - acc: 0.9984
    Epoch 712/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0126 - acc: 0.9988
    Epoch 713/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0137 - acc: 0.9984
    Epoch 714/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0144 - acc: 0.9984
    Epoch 715/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0141 - acc: 0.9984
    Epoch 716/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0128 - acc: 0.9992
    Epoch 717/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0128 - acc: 0.9984
    Epoch 718/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0156 - acc: 0.9984
    Epoch 719/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0182 - acc: 0.9984
    Epoch 720/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0129 - acc: 0.9988
    Epoch 721/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0153 - acc: 0.9980
    Epoch 722/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0162 - acc: 0.9977
    Epoch 723/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0250 - acc: 0.9961
    Epoch 724/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0347 - acc: 0.9914
    Epoch 725/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.0804 - acc: 0.9789
    Epoch 726/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1650 - acc: 0.9453
    Epoch 727/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1505 - acc: 0.9527
    Epoch 728/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1459 - acc: 0.9492
    Epoch 729/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1153 - acc: 0.9648
    Epoch 730/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1376 - acc: 0.9562
    Epoch 731/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1679 - acc: 0.9410
    Epoch 732/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1355 - acc: 0.9547
    Epoch 733/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1588 - acc: 0.9515
    Epoch 734/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1912 - acc: 0.9363
    Epoch 735/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.2075 - acc: 0.9367
    Epoch 736/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1526 - acc: 0.9445
    Epoch 737/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1284 - acc: 0.9547
    Epoch 738/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1010 - acc: 0.9637
    Epoch 739/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1303 - acc: 0.9601
    Epoch 740/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0844 - acc: 0.9719
    Epoch 741/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1208 - acc: 0.9613
    Epoch 742/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0743 - acc: 0.9766
    Epoch 743/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0939 - acc: 0.9703
    Epoch 744/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0965 - acc: 0.9680
    Epoch 745/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0706 - acc: 0.9793
    Epoch 746/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0596 - acc: 0.9844
    Epoch 747/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0685 - acc: 0.9816
    Epoch 748/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.4446 - acc: 0.8750
    Epoch 749/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.4874 - acc: 0.8781
    Epoch 750/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.4645 - acc: 0.8671
    Epoch 751/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.5133 - acc: 0.8523
    Epoch 752/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.3597 - acc: 0.8816
    Epoch 753/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.2920 - acc: 0.8921
    Epoch 754/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2670 - acc: 0.9039
    Epoch 755/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3080 - acc: 0.8918
    Epoch 756/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.2025 - acc: 0.9187
    Epoch 757/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.2437 - acc: 0.9035
    Epoch 758/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1800 - acc: 0.9328
    Epoch 759/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1991 - acc: 0.9234
    Epoch 760/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1623 - acc: 0.9328
    Epoch 761/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1356 - acc: 0.9469
    Epoch 762/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1349 - acc: 0.9465
    Epoch 763/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1093 - acc: 0.9562
    Epoch 764/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0925 - acc: 0.9699
    Epoch 765/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0990 - acc: 0.9668
    Epoch 766/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0655 - acc: 0.9848
    Epoch 767/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0761 - acc: 0.9769
    Epoch 768/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0617 - acc: 0.9840
    Epoch 769/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0519 - acc: 0.9883
    Epoch 770/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0601 - acc: 0.9832
    Epoch 771/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0464 - acc: 0.9910
    Epoch 772/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0438 - acc: 0.9934
    Epoch 773/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0428 - acc: 0.9937
    Epoch 774/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0397 - acc: 0.9957
    Epoch 775/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0389 - acc: 0.9953
    Epoch 776/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0358 - acc: 0.9969
    Epoch 777/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0318 - acc: 0.9977
    Epoch 778/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0316 - acc: 0.9980
    Epoch 779/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0310 - acc: 0.9977
    Epoch 780/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0269 - acc: 0.9992
    Epoch 781/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0280 - acc: 0.9984
    Epoch 782/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0294 - acc: 0.9977
    Epoch 783/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0256 - acc: 0.9988
    Epoch 784/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0266 - acc: 0.9984
    Epoch 785/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0245 - acc: 0.9992
    Epoch 786/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0234 - acc: 0.9988
    Epoch 787/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0230 - acc: 0.9988
    Epoch 788/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0239 - acc: 0.9977
    Epoch 789/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.0252 - acc: 0.9969
    Epoch 790/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0216 - acc: 0.9988
    Epoch 791/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0229 - acc: 0.9984
    Epoch 792/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0217 - acc: 0.9988
    Epoch 793/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0203 - acc: 0.9992
    Epoch 794/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0207 - acc: 0.9988
    Epoch 795/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0200 - acc: 0.9988
    Epoch 796/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0201 - acc: 0.9984
    Epoch 797/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0201 - acc: 0.9984
    Epoch 798/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0186 - acc: 0.9992
    Epoch 799/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0190 - acc: 0.9984
    Epoch 800/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0188 - acc: 0.9992
    Epoch 801/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0198 - acc: 0.9984
    Epoch 802/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0184 - acc: 0.9988
    Epoch 803/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0178 - acc: 0.9992
    Epoch 804/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0178 - acc: 0.9984
    Epoch 805/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0176 - acc: 0.9988
    Epoch 806/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0171 - acc: 0.9984
    Epoch 807/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0169 - acc: 0.9988
    Epoch 808/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0172 - acc: 0.9984
    Epoch 809/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0167 - acc: 0.9988
    Epoch 810/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0184 - acc: 0.9977
    Epoch 811/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0164 - acc: 0.9988
    Epoch 812/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0165 - acc: 0.9988
    Epoch 813/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0161 - acc: 0.9984
    Epoch 814/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0154 - acc: 0.9988
    Epoch 815/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0154 - acc: 0.9992
    Epoch 816/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0161 - acc: 0.9984
    Epoch 817/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0153 - acc: 0.9980
    Epoch 818/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0152 - acc: 0.9980
    Epoch 819/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0145 - acc: 0.9992
    Epoch 820/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0157 - acc: 0.9988
    Epoch 821/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0141 - acc: 0.9988
    Epoch 822/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0145 - acc: 0.9988
    Epoch 823/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0137 - acc: 0.9988
    Epoch 824/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0130 - acc: 0.9992
    Epoch 825/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0136 - acc: 0.9988
    Epoch 826/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0140 - acc: 0.9984
    Epoch 827/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0140 - acc: 0.9984
    Epoch 828/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0124 - acc: 0.9992
    Epoch 829/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0128 - acc: 0.9988
    Epoch 830/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0129 - acc: 0.9988
    Epoch 831/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0135 - acc: 0.9980
    Epoch 832/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0133 - acc: 0.9984
    Epoch 833/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0116 - acc: 0.9992
    Epoch 834/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0131 - acc: 0.9988
    Epoch 835/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0136 - acc: 0.9977
    Epoch 836/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0126 - acc: 0.9984
    Epoch 837/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0127 - acc: 0.9988
    Epoch 838/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0138 - acc: 0.9980
    Epoch 839/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0116 - acc: 0.9988
    Epoch 840/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0113 - acc: 0.9988
    Epoch 841/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0116 - acc: 0.9988
    Epoch 842/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0123 - acc: 0.9984
    Epoch 843/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0116 - acc: 0.9984
    Epoch 844/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0137 - acc: 0.9980
    Epoch 845/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0111 - acc: 0.9992
    Epoch 846/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0105 - acc: 0.9988
    Epoch 847/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0118 - acc: 0.9988
    Epoch 848/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0127 - acc: 0.9988
    Epoch 849/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0104 - acc: 0.9992
    Epoch 850/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0112 - acc: 0.9988
    Epoch 851/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0114 - acc: 0.9984
    Epoch 852/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0108 - acc: 0.9984
    Epoch 853/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0108 - acc: 0.9992
    Epoch 854/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0118 - acc: 0.9988
    Epoch 855/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0104 - acc: 0.9992
    Epoch 856/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0107 - acc: 0.9988
    Epoch 857/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0104 - acc: 0.9988
    Epoch 858/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0092 - acc: 0.9992
    Epoch 859/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0100 - acc: 0.9992
    Epoch 860/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0099 - acc: 0.9988
    Epoch 861/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0101 - acc: 0.9984
    Epoch 862/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0092 - acc: 0.9988
    Epoch 863/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0092 - acc: 0.9988
    Epoch 864/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0093 - acc: 0.9988
    Epoch 865/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0084 - acc: 0.9992
    Epoch 866/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0085 - acc: 0.9988
    Epoch 867/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0090 - acc: 0.9988
    Epoch 868/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0100 - acc: 0.9973
    Epoch 869/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0078 - acc: 0.9988
    Epoch 870/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0074 - acc: 0.9992
    Epoch 871/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0078 - acc: 0.9992
    Epoch 872/3000
    2559/2559 [==============================] - 17s 6ms/step - loss: 0.0080 - acc: 0.9996
    Epoch 873/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0074 - acc: 0.9996
    Epoch 874/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0077 - acc: 0.9992
    Epoch 875/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0084 - acc: 0.9988
    Epoch 876/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0073 - acc: 0.9996
    Epoch 877/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0072 - acc: 0.9996
    Epoch 878/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0068 - acc: 0.9996
    Epoch 879/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0070 - acc: 0.9996
    Epoch 880/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0070 - acc: 0.9996
    Epoch 881/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0075 - acc: 0.9992
    Epoch 882/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0065 - acc: 0.9996
    Epoch 883/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0066 - acc: 0.9992
    Epoch 884/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0064 - acc: 0.9996
    Epoch 885/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0068 - acc: 0.9992
    Epoch 886/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0065 - acc: 0.9992
    Epoch 887/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0088 - acc: 0.9980
    Epoch 888/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0066 - acc: 0.9996
    Epoch 889/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0071 - acc: 0.9992
    Epoch 890/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0077 - acc: 0.9992
    Epoch 891/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0058 - acc: 0.9996
    Epoch 892/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0058 - acc: 0.9996
    Epoch 893/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0073 - acc: 0.9988
    Epoch 894/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0060 - acc: 0.9996
    Epoch 895/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.0061 - acc: 0.9996
    Epoch 896/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0060 - acc: 0.9992
    Epoch 897/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0055 - acc: 0.9996
    Epoch 898/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0059 - acc: 0.9996
    Epoch 899/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0058 - acc: 0.9996
    Epoch 900/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0063 - acc: 0.9996
    Epoch 901/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0058 - acc: 0.9996
    Epoch 902/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0062 - acc: 0.9992
    Epoch 903/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0055 - acc: 0.9996
    Epoch 904/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0061 - acc: 0.9992
    Epoch 905/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0056 - acc: 0.9992
    Epoch 906/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0073 - acc: 0.9984
    Epoch 907/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0054 - acc: 0.9996
    Epoch 908/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0056 - acc: 0.9996
    Epoch 909/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0048 - acc: 0.9996
    Epoch 910/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0054 - acc: 0.9996
    Epoch 911/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0066 - acc: 0.9996
    Epoch 912/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0050 - acc: 1.0000
    Epoch 913/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0059 - acc: 0.9996
    Epoch 914/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0051 - acc: 0.9996
    Epoch 915/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0061 - acc: 0.9992
    Epoch 916/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0062 - acc: 0.9996
    Epoch 917/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0051 - acc: 1.0000
    Epoch 918/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0055 - acc: 0.9996
    Epoch 919/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0056 - acc: 0.9996
    Epoch 920/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0046 - acc: 1.0000
    Epoch 921/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0064 - acc: 0.9984
    Epoch 922/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0050 - acc: 1.0000
    Epoch 923/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0083 - acc: 0.9992
    Epoch 924/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0054 - acc: 0.9996
    Epoch 925/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0049 - acc: 0.9996
    Epoch 926/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0070 - acc: 0.9988
    Epoch 927/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0057 - acc: 0.9992
    Epoch 928/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0046 - acc: 1.0000
    Epoch 929/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0042 - acc: 1.0000
    Epoch 930/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0048 - acc: 1.0000
    Epoch 931/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0055 - acc: 0.9996
    Epoch 932/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0052 - acc: 0.9992
    Epoch 933/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0059 - acc: 0.9988
    Epoch 934/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0043 - acc: 1.0000
    Epoch 935/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0050 - acc: 0.9992
    Epoch 936/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0041 - acc: 1.0000
    Epoch 937/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0045 - acc: 1.0000
    Epoch 938/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0043 - acc: 0.9996
    Epoch 939/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0042 - acc: 1.0000
    Epoch 940/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0053 - acc: 0.9988
    Epoch 941/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0042 - acc: 0.9996
    Epoch 942/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0083 - acc: 0.9992
    Epoch 943/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0158 - acc: 0.9969
    Epoch 944/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0351 - acc: 0.9898
    Epoch 945/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0373 - acc: 0.9898
    Epoch 946/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0547 - acc: 0.9809
    Epoch 947/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0409 - acc: 0.9859
    Epoch 948/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0388 - acc: 0.9906
    Epoch 949/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0457 - acc: 0.9844
    Epoch 950/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0266 - acc: 0.9934
    Epoch 951/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0323 - acc: 0.9902
    Epoch 952/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0354 - acc: 0.9930
    Epoch 953/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0365 - acc: 0.9902
    Epoch 954/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0252 - acc: 0.9953
    Epoch 955/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0218 - acc: 0.9977
    Epoch 956/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0197 - acc: 0.9953
    Epoch 957/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0335 - acc: 0.9910
    Epoch 958/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0323 - acc: 0.9922
    Epoch 959/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0295 - acc: 0.9934
    Epoch 960/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0359 - acc: 0.9883
    Epoch 961/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0394 - acc: 0.9875
    Epoch 962/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0309 - acc: 0.9930
    Epoch 963/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0359 - acc: 0.9906
    Epoch 964/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0322 - acc: 0.9930
    Epoch 965/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0311 - acc: 0.9902
    Epoch 966/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0452 - acc: 0.9848
    Epoch 967/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0443 - acc: 0.9887
    Epoch 968/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0548 - acc: 0.9855
    Epoch 969/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0670 - acc: 0.9789
    Epoch 970/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1470 - acc: 0.9578
    Epoch 971/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1388 - acc: 0.9562
    Epoch 972/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1162 - acc: 0.9609
    Epoch 973/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1255 - acc: 0.9601
    Epoch 974/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0722 - acc: 0.9789
    Epoch 975/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0701 - acc: 0.9750
    Epoch 976/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0661 - acc: 0.9777
    Epoch 977/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0706 - acc: 0.9762
    Epoch 978/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0500 - acc: 0.9848
    Epoch 979/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0594 - acc: 0.9777
    Epoch 980/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0476 - acc: 0.9875
    Epoch 981/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0324 - acc: 0.9930
    Epoch 982/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0339 - acc: 0.9894
    Epoch 983/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0355 - acc: 0.9871
    Epoch 984/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0254 - acc: 0.9945
    Epoch 985/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0223 - acc: 0.9965
    Epoch 986/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0187 - acc: 0.9973
    Epoch 987/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0142 - acc: 0.9977
    Epoch 988/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0117 - acc: 0.9980
    Epoch 989/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0116 - acc: 0.9988
    Epoch 990/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0141 - acc: 0.9980
    Epoch 991/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0142 - acc: 0.9980
    Epoch 992/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0129 - acc: 0.9969
    Epoch 993/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0119 - acc: 0.9984
    Epoch 994/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0093 - acc: 0.9984
    Epoch 995/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0078 - acc: 0.9992
    Epoch 996/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0075 - acc: 0.9996
    Epoch 997/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0083 - acc: 0.9992
    Epoch 998/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0077 - acc: 0.9992
    Epoch 999/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0061 - acc: 1.0000
    Epoch 1000/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0061 - acc: 0.9996
    Epoch 1001/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0073 - acc: 0.9988
    Epoch 1002/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0056 - acc: 1.0000
    Epoch 1003/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0050 - acc: 1.0000
    Epoch 1004/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0054 - acc: 0.9996
    Epoch 1005/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0051 - acc: 1.0000
    Epoch 1006/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0057 - acc: 0.9996
    Epoch 1007/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0046 - acc: 1.0000
    Epoch 1008/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0066 - acc: 0.9992
    Epoch 1009/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0048 - acc: 0.9996
    Epoch 1010/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0067 - acc: 0.9984
    Epoch 1011/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0043 - acc: 1.0000
    Epoch 1012/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0045 - acc: 0.9996
    Epoch 1013/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0041 - acc: 1.0000
    Epoch 1014/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0054 - acc: 0.9992
    Epoch 1015/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0038 - acc: 1.0000
    Epoch 1016/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0055 - acc: 0.9988
    Epoch 1017/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0040 - acc: 1.0000
    Epoch 1018/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0043 - acc: 0.9996
    Epoch 1019/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0049 - acc: 0.9992
    Epoch 1020/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0039 - acc: 1.0000
    Epoch 1021/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0043 - acc: 0.9996
    Epoch 1022/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0044 - acc: 0.9996
    Epoch 1023/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0042 - acc: 1.0000
    Epoch 1024/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0046 - acc: 0.9996
    Epoch 1025/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0037 - acc: 1.0000
    Epoch 1026/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0038 - acc: 0.9996
    Epoch 1027/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0033 - acc: 1.0000
    Epoch 1028/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0045 - acc: 0.9992
    Epoch 1029/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0050 - acc: 0.9996
    Epoch 1030/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0034 - acc: 0.9996
    Epoch 1031/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0036 - acc: 1.0000
    Epoch 1032/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0048 - acc: 0.9992
    Epoch 1033/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0032 - acc: 1.0000
    Epoch 1034/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0042 - acc: 0.9996
    Epoch 1035/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0039 - acc: 0.9996
    Epoch 1036/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0040 - acc: 1.0000
    Epoch 1037/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0042 - acc: 0.9996
    Epoch 1038/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0033 - acc: 1.0000
    Epoch 1039/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0043 - acc: 0.9992
    Epoch 1040/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0036 - acc: 1.0000
    Epoch 1041/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0036 - acc: 1.0000
    Epoch 1042/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0037 - acc: 0.9996
    Epoch 1043/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0030 - acc: 1.0000
    Epoch 1044/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0036 - acc: 0.9996
    Epoch 1045/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0034 - acc: 0.9996
    Epoch 1046/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0033 - acc: 0.9996
    Epoch 1047/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0030 - acc: 1.0000
    Epoch 1048/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0037 - acc: 0.9996
    Epoch 1049/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0026 - acc: 1.0000
    Epoch 1050/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0029 - acc: 1.0000
    Epoch 1051/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0038 - acc: 0.9988
    Epoch 1052/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0028 - acc: 1.0000
    Epoch 1053/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0048 - acc: 0.9996
    Epoch 1054/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0028 - acc: 1.0000
    Epoch 1055/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0030 - acc: 0.9996
    Epoch 1056/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0028 - acc: 1.0000
    Epoch 1057/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0033 - acc: 0.9996
    Epoch 1058/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0029 - acc: 1.0000
    Epoch 1059/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0040 - acc: 0.9992
    Epoch 1060/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1061/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0026 - acc: 1.0000
    Epoch 1062/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0025 - acc: 1.0000
    Epoch 1063/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0027 - acc: 1.0000
    Epoch 1064/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0030 - acc: 1.0000
    Epoch 1065/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1066/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 1067/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1068/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1069/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1070/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0026 - acc: 1.0000
    Epoch 1071/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 1072/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0029 - acc: 1.0000
    Epoch 1073/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 1074/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0029 - acc: 0.9996
    Epoch 1075/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1076/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0028 - acc: 1.0000
    Epoch 1077/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0025 - acc: 1.0000
    Epoch 1078/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 1079/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1080/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1081/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 1082/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 1083/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 1084/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1085/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0033 - acc: 0.9992
    Epoch 1086/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0029 - acc: 0.9992
    Epoch 1087/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 1088/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0029 - acc: 0.9996
    Epoch 1089/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0036 - acc: 0.9988
    Epoch 1090/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0053 - acc: 0.9988
    Epoch 1091/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 1092/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0030 - acc: 0.9996
    Epoch 1093/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0026 - acc: 0.9996
    Epoch 1094/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 1095/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1096/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1097/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1098/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0031 - acc: 0.9992
    Epoch 1099/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 1100/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0027 - acc: 1.0000
    Epoch 1101/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 1102/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0027 - acc: 0.9996
    Epoch 1103/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0029 - acc: 0.9996
    Epoch 1104/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 0.9992
    Epoch 1105/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0041 - acc: 0.9996
    Epoch 1106/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0025 - acc: 1.0000
    Epoch 1107/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0037 - acc: 0.9988
    Epoch 1108/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0036 - acc: 0.9996
    Epoch 1109/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 1.0000
    Epoch 1110/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0042 - acc: 0.9996
    Epoch 1111/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1112/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0033 - acc: 0.9992
    Epoch 1113/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1114/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0026 - acc: 0.9996
    Epoch 1115/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 1116/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 1117/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 1118/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0026 - acc: 0.9996
    Epoch 1119/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 1120/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0035 - acc: 0.9992
    Epoch 1121/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0026 - acc: 1.0000
    Epoch 1122/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0027 - acc: 0.9996
    Epoch 1123/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 1124/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0032 - acc: 0.9996
    Epoch 1125/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 1126/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 1127/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1128/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0025 - acc: 0.9996
    Epoch 1129/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1130/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1131/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 1132/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1133/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1134/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1135/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1136/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 1137/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0027 - acc: 0.9996
    Epoch 1138/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0029 - acc: 0.9992
    Epoch 1139/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1140/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1141/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0031 - acc: 0.9996
    Epoch 1142/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 1143/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1144/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0035 - acc: 0.9992
    Epoch 1145/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 1146/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1147/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1148/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1149/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1150/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1151/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1152/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 1153/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1154/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1155/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1156/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1157/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1158/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1159/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1160/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1161/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 1162/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1163/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1164/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1165/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1166/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 1167/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1168/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1169/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1170/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1171/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1172/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0024 - acc: 0.9992
    Epoch 1173/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1174/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0025 - acc: 0.9996
    Epoch 1175/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0031 - acc: 0.9992
    Epoch 1176/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1177/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1178/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 1179/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1180/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1181/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1182/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1183/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1184/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1185/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1186/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 1187/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1188/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1189/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 1190/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1191/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1192/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1193/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0025 - acc: 0.9996
    Epoch 1194/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1195/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1196/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1197/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1198/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1199/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0034 - acc: 0.9992
    Epoch 1200/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1201/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1202/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1203/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0029 - acc: 0.9996
    Epoch 1204/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0025 - acc: 0.9996
    Epoch 1205/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1206/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1207/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0019 - acc: 0.9992
    Epoch 1208/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 0.9992
    Epoch 1209/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1210/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1211/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1212/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1213/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1214/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1215/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1216/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1217/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1218/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1219/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 1220/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1221/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1222/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0027 - acc: 0.9992
    Epoch 1223/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0029 - acc: 0.9992
    Epoch 1224/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0025 - acc: 0.9996
    Epoch 1225/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1226/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1227/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1228/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1229/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1230/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1231/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1232/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1233/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1234/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 1235/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1236/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1237/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1238/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1239/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0026 - acc: 0.9996
    Epoch 1240/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1241/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1242/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1243/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1244/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1245/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1246/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0024 - acc: 0.9992
    Epoch 1247/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1248/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1249/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1250/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1251/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1252/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1253/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1254/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0020 - acc: 0.9992
    Epoch 1255/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1256/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1257/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1258/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1259/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1260/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1261/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 9.9693e-04 - acc: 1.0000
    Epoch 1262/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1263/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.9204e-04 - acc: 1.0000
    Epoch 1264/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1265/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1266/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 8.8307e-04 - acc: 1.0000
    Epoch 1267/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 9.9428e-04 - acc: 1.0000
    Epoch 1268/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1269/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1270/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1271/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1272/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1273/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1274/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1275/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1276/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1277/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1278/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1279/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1280/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1281/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1282/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1283/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1284/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1285/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0029 - acc: 0.9992
    Epoch 1286/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1287/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1288/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1289/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.0539e-04 - acc: 1.0000
    Epoch 1290/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 0.9992
    Epoch 1291/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1292/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1293/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1294/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1295/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1296/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.9659e-04 - acc: 1.0000
    Epoch 1297/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1298/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1299/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1300/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.9906e-04 - acc: 1.0000
    Epoch 1301/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.2747e-04 - acc: 1.0000
    Epoch 1302/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.1677e-04 - acc: 1.0000
    Epoch 1303/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.5382e-04 - acc: 1.0000
    Epoch 1304/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1305/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.4748e-04 - acc: 1.0000
    Epoch 1306/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.2973e-04 - acc: 1.0000
    Epoch 1307/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 8.9974e-04 - acc: 1.0000
    Epoch 1308/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1309/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.8472e-04 - acc: 1.0000
    Epoch 1310/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.4426e-04 - acc: 1.0000
    Epoch 1311/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.0283e-04 - acc: 1.0000
    Epoch 1312/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1313/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.2762e-04 - acc: 1.0000
    Epoch 1314/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1315/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1316/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.2959e-04 - acc: 1.0000
    Epoch 1317/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.7351e-04 - acc: 1.0000
    Epoch 1318/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1319/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1320/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1321/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1322/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.5057e-04 - acc: 1.0000
    Epoch 1323/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0019 - acc: 0.9992
    Epoch 1324/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1325/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1326/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1327/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1328/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.4733e-04 - acc: 1.0000
    Epoch 1329/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1330/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0027 - acc: 0.9992
    Epoch 1331/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1332/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0042 - acc: 0.9992
    Epoch 1333/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1334/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0030 - acc: 0.9992
    Epoch 1335/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 1336/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1337/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 1338/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1339/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0027 - acc: 0.9996
    Epoch 1340/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1341/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1342/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1343/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1344/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0025 - acc: 0.9996
    Epoch 1345/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1346/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0025 - acc: 0.9996
    Epoch 1347/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1348/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1349/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1350/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0023 - acc: 0.9988
    Epoch 1351/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.8075e-04 - acc: 1.0000
    Epoch 1352/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1353/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 1354/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1355/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0027 - acc: 0.9992
    Epoch 1356/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0024 - acc: 0.9988
    Epoch 1357/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0023 - acc: 0.9992
    Epoch 1358/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1359/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1360/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1361/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1362/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.5107e-04 - acc: 1.0000
    Epoch 1363/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.9164e-04 - acc: 1.0000
    Epoch 1364/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.9417e-04 - acc: 1.0000
    Epoch 1365/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1366/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1367/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.3809e-04 - acc: 1.0000
    Epoch 1368/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1369/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 7.4826e-04 - acc: 1.0000
    Epoch 1370/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.4487e-04 - acc: 1.0000
    Epoch 1371/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 1372/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 7.0905e-04 - acc: 1.0000
    Epoch 1373/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.7977e-04 - acc: 1.0000
    Epoch 1374/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.8764e-04 - acc: 1.0000
    Epoch 1375/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.4173e-04 - acc: 1.0000
    Epoch 1376/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.2549e-04 - acc: 1.0000
    Epoch 1377/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.4445e-04 - acc: 1.0000
    Epoch 1378/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 1379/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1380/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.1270e-04 - acc: 1.0000
    Epoch 1381/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1382/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.5761e-04 - acc: 1.0000
    Epoch 1383/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 0.9992
    Epoch 1384/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 7.2967e-04 - acc: 1.0000
    Epoch 1385/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.3889e-04 - acc: 1.0000
    Epoch 1386/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.7563e-04 - acc: 1.0000
    Epoch 1387/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1388/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1389/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1390/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1391/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1392/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1393/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0045 - acc: 0.9988
    Epoch 1394/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0121 - acc: 0.9957
    Epoch 1395/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0089 - acc: 0.9977
    Epoch 1396/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0078 - acc: 0.9973
    Epoch 1397/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0054 - acc: 0.9996
    Epoch 1398/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0264 - acc: 0.9922
    Epoch 1399/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0810 - acc: 0.9766
    Epoch 1400/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1266 - acc: 0.9617
    Epoch 1401/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0617 - acc: 0.9793
    Epoch 1402/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1303 - acc: 0.9652
    Epoch 1403/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1410 - acc: 0.9601
    Epoch 1404/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1686 - acc: 0.9539
    Epoch 1405/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.3668 - acc: 0.9148
    Epoch 1406/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.4858 - acc: 0.8929
    Epoch 1407/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.4930 - acc: 0.8925
    Epoch 1408/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3648 - acc: 0.9074
    Epoch 1409/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2528 - acc: 0.9332
    Epoch 1410/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2292 - acc: 0.9304
    Epoch 1411/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.3050 - acc: 0.9097
    Epoch 1412/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.3516 - acc: 0.8941
    Epoch 1413/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.3310 - acc: 0.9035
    Epoch 1414/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.2968 - acc: 0.9070
    Epoch 1415/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1827 - acc: 0.9437
    Epoch 1416/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1473 - acc: 0.9445
    Epoch 1417/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1129 - acc: 0.9586
    Epoch 1418/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0766 - acc: 0.9699
    Epoch 1419/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0724 - acc: 0.9707
    Epoch 1420/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1440 - acc: 0.9488
    Epoch 1421/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0519 - acc: 0.9820
    Epoch 1422/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0690 - acc: 0.9766
    Epoch 1423/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0689 - acc: 0.9750
    Epoch 1424/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0463 - acc: 0.9855
    Epoch 1425/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0404 - acc: 0.9871
    Epoch 1426/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0367 - acc: 0.9894
    Epoch 1427/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0249 - acc: 0.9945
    Epoch 1428/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0289 - acc: 0.9937
    Epoch 1429/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0151 - acc: 0.9984
    Epoch 1430/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0197 - acc: 0.9953
    Epoch 1431/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0199 - acc: 0.9969
    Epoch 1432/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0162 - acc: 0.9969
    Epoch 1433/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0161 - acc: 0.9984
    Epoch 1434/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0131 - acc: 0.9984
    Epoch 1435/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0150 - acc: 0.9980
    Epoch 1436/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0139 - acc: 0.9977
    Epoch 1437/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0110 - acc: 0.9984
    Epoch 1438/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0110 - acc: 0.9984
    Epoch 1439/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0076 - acc: 0.9996
    Epoch 1440/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0074 - acc: 0.9996
    Epoch 1441/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0069 - acc: 0.9996
    Epoch 1442/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0064 - acc: 1.0000
    Epoch 1443/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0069 - acc: 0.9996
    Epoch 1444/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0070 - acc: 0.9992
    Epoch 1445/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0063 - acc: 0.9996
    Epoch 1446/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0055 - acc: 1.0000
    Epoch 1447/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0063 - acc: 0.9992
    Epoch 1448/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0054 - acc: 0.9996
    Epoch 1449/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0054 - acc: 0.9996
    Epoch 1450/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0068 - acc: 0.9988
    Epoch 1451/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0047 - acc: 1.0000
    Epoch 1452/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0048 - acc: 0.9996
    Epoch 1453/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0052 - acc: 1.0000
    Epoch 1454/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0050 - acc: 1.0000
    Epoch 1455/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0049 - acc: 0.9996
    Epoch 1456/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0045 - acc: 1.0000
    Epoch 1457/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0038 - acc: 1.0000
    Epoch 1458/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0043 - acc: 0.9996
    Epoch 1459/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0043 - acc: 0.9996
    Epoch 1460/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0040 - acc: 1.0000
    Epoch 1461/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0038 - acc: 1.0000
    Epoch 1462/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0052 - acc: 0.9992
    Epoch 1463/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0036 - acc: 1.0000
    Epoch 1464/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0049 - acc: 0.9988
    Epoch 1465/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0040 - acc: 0.9992
    Epoch 1466/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0058 - acc: 0.9984
    Epoch 1467/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0034 - acc: 1.0000
    Epoch 1468/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0038 - acc: 1.0000
    Epoch 1469/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0037 - acc: 1.0000
    Epoch 1470/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0036 - acc: 0.9996
    Epoch 1471/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0036 - acc: 1.0000
    Epoch 1472/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0032 - acc: 1.0000
    Epoch 1473/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0032 - acc: 1.0000
    Epoch 1474/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0030 - acc: 1.0000
    Epoch 1475/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0044 - acc: 0.9996
    Epoch 1476/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0032 - acc: 1.0000
    Epoch 1477/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0034 - acc: 1.0000
    Epoch 1478/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0042 - acc: 1.0000
    Epoch 1479/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0037 - acc: 1.0000
    Epoch 1480/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0037 - acc: 0.9996
    Epoch 1481/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0033 - acc: 1.0000
    Epoch 1482/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0041 - acc: 0.9996
    Epoch 1483/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0033 - acc: 1.0000
    Epoch 1484/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0037 - acc: 1.0000
    Epoch 1485/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0035 - acc: 1.0000
    Epoch 1486/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0039 - acc: 0.9996
    Epoch 1487/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0051 - acc: 0.9992
    Epoch 1488/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0032 - acc: 1.0000
    Epoch 1489/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0041 - acc: 0.9996
    Epoch 1490/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0036 - acc: 0.9996
    Epoch 1491/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0038 - acc: 0.9992
    Epoch 1492/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 1.0000
    Epoch 1493/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0033 - acc: 0.9996
    Epoch 1494/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0026 - acc: 1.0000
    Epoch 1495/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 1496/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0025 - acc: 1.0000
    Epoch 1497/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0025 - acc: 1.0000
    Epoch 1498/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0027 - acc: 1.0000
    Epoch 1499/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1500/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 1501/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1502/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0037 - acc: 0.9996
    Epoch 1503/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1504/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0033 - acc: 0.9996
    Epoch 1505/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0031 - acc: 1.0000
    Epoch 1506/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0030 - acc: 0.9996
    Epoch 1507/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0037 - acc: 0.9992
    Epoch 1508/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0025 - acc: 1.0000
    Epoch 1509/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1510/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1511/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0031 - acc: 0.9996
    Epoch 1512/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0027 - acc: 1.0000
    Epoch 1513/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 1514/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 1515/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0029 - acc: 0.9992
    Epoch 1516/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 1517/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0025 - acc: 1.0000
    Epoch 1518/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 1519/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0026 - acc: 0.9996
    Epoch 1520/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1521/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 1522/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0027 - acc: 0.9996
    Epoch 1523/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 1524/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1525/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 1526/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 1527/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 1528/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0030 - acc: 0.9992
    Epoch 1529/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1530/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1531/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0040 - acc: 0.9992
    Epoch 1532/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0037 - acc: 0.9992
    Epoch 1533/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 1.0000
    Epoch 1534/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0029 - acc: 1.0000
    Epoch 1535/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 1536/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0026 - acc: 0.9996
    Epoch 1537/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0031 - acc: 0.9996
    Epoch 1538/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 1539/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 1540/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1541/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 1542/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1543/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1544/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1545/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0035 - acc: 0.9992
    Epoch 1546/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0040 - acc: 0.9992
    Epoch 1547/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1548/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 1549/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1550/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 1551/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 1552/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0036 - acc: 0.9988
    Epoch 1553/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1554/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0026 - acc: 0.9992
    Epoch 1555/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1556/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0026 - acc: 0.9992
    Epoch 1557/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1558/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0026 - acc: 0.9992
    Epoch 1559/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0030 - acc: 0.9996
    Epoch 1560/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1561/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1562/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1563/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1564/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1565/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1566/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 1567/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1568/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1569/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0026 - acc: 0.9996
    Epoch 1570/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1571/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1572/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1573/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 0.9992
    Epoch 1574/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 1575/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1576/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1577/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 1578/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 0.9992
    Epoch 1579/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 1580/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 1581/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1582/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1583/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 1584/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1585/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1586/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1587/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1588/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1589/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 1590/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0022 - acc: 0.9992
    Epoch 1591/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 1592/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1593/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1594/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1595/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 1596/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1597/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1598/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0027 - acc: 0.9988
    Epoch 1599/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1600/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1601/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1602/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1603/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1604/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1605/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1606/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1607/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1608/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1609/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 1610/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1611/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1612/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0023 - acc: 0.9992
    Epoch 1613/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 1614/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1615/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1616/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1617/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1618/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1619/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1620/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1621/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1622/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1623/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1624/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1625/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 1626/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1627/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1628/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1629/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1630/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0027 - acc: 0.9992
    Epoch 1631/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1632/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1633/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1634/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0025 - acc: 0.9996
    Epoch 1635/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1636/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1637/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.9953e-04 - acc: 1.0000
    Epoch 1638/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1639/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1640/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1641/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1642/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.1869e-04 - acc: 1.0000
    Epoch 1643/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.6956e-04 - acc: 1.0000
    Epoch 1644/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1645/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.8567e-04 - acc: 1.0000
    Epoch 1646/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.8538e-04 - acc: 1.0000
    Epoch 1647/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1648/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1649/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 8.6725e-04 - acc: 1.0000
    Epoch 1650/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 1651/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1652/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1653/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1654/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 0.9992
    Epoch 1655/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1656/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1657/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 8.2649e-04 - acc: 1.0000
    Epoch 1658/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.2594e-04 - acc: 1.0000
    Epoch 1659/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1660/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1661/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1662/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1663/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1664/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1665/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1666/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 1667/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1668/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1669/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1670/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1671/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 1672/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.4803e-04 - acc: 1.0000
    Epoch 1673/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1674/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0028 - acc: 0.9992
    Epoch 1675/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1676/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0027 - acc: 0.9996
    Epoch 1677/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 1678/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0042 - acc: 0.9984
    Epoch 1679/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1680/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1681/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1682/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0036 - acc: 0.9992
    Epoch 1683/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1684/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0028 - acc: 0.9992
    Epoch 1685/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.9811e-04 - acc: 1.0000
    Epoch 1686/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.4444e-04 - acc: 1.0000
    Epoch 1687/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0023 - acc: 0.9992
    Epoch 1688/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.6184e-04 - acc: 1.0000
    Epoch 1689/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.7567e-04 - acc: 1.0000
    Epoch 1690/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 1691/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.6041e-04 - acc: 1.0000
    Epoch 1692/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1693/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 8.4027e-04 - acc: 1.0000
    Epoch 1694/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0023 - acc: 0.9992
    Epoch 1695/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1696/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1697/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1698/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1699/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1700/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1701/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1702/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1703/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 8.0908e-04 - acc: 1.0000
    Epoch 1704/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 9.6059e-04 - acc: 1.0000
    Epoch 1705/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1706/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 7.9062e-04 - acc: 1.0000
    Epoch 1707/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1708/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1709/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.7831e-04 - acc: 1.0000
    Epoch 1710/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 1711/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.6347e-04 - acc: 0.9996
    Epoch 1712/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.2996e-04 - acc: 1.0000
    Epoch 1713/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1714/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1715/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1716/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1717/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1718/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 1719/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1720/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1721/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1722/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1723/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.8074e-04 - acc: 1.0000
    Epoch 1724/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0010 - acc: 0.9996
    Epoch 1725/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.1001e-04 - acc: 1.0000
    Epoch 1726/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1727/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1728/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.7713e-04 - acc: 1.0000
    Epoch 1729/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1730/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 8.4375e-04 - acc: 1.0000
    Epoch 1731/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1732/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.8542e-04 - acc: 1.0000
    Epoch 1733/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.3643e-04 - acc: 1.0000
    Epoch 1734/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 7.7302e-04 - acc: 1.0000
    Epoch 1735/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1736/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.6003e-04 - acc: 1.0000
    Epoch 1737/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.6922e-04 - acc: 1.0000
    Epoch 1738/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.5549e-04 - acc: 1.0000
    Epoch 1739/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.8217e-04 - acc: 1.0000
    Epoch 1740/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.5275e-04 - acc: 1.0000
    Epoch 1741/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.4522e-04 - acc: 1.0000
    Epoch 1742/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1743/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 7.1940e-04 - acc: 1.0000
    Epoch 1744/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1745/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.3246e-04 - acc: 1.0000
    Epoch 1746/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.8984e-04 - acc: 1.0000
    Epoch 1747/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.6081e-04 - acc: 1.0000
    Epoch 1748/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.7911e-04 - acc: 1.0000
    Epoch 1749/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0031 - acc: 0.9988
    Epoch 1750/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.1340e-04 - acc: 1.0000
    Epoch 1751/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 7.6682e-04 - acc: 1.0000
    Epoch 1752/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 1753/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.7535e-04 - acc: 1.0000
    Epoch 1754/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.4023e-04 - acc: 1.0000
    Epoch 1755/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 1756/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1757/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.7614e-04 - acc: 1.0000
    Epoch 1758/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 1759/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0021 - acc: 0.9992
    Epoch 1760/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 7.7468e-04 - acc: 1.0000
    Epoch 1761/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1762/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 7.2135e-04 - acc: 1.0000
    Epoch 1763/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1764/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0024 - acc: 0.9992
    Epoch 1765/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1766/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.7594e-04 - acc: 1.0000
    Epoch 1767/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1768/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 1769/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1770/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 9.6743e-04 - acc: 0.9996
    Epoch 1771/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1772/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1773/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0025 - acc: 0.9992
    Epoch 1774/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.4416e-04 - acc: 1.0000
    Epoch 1775/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1776/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0022 - acc: 0.9988
    Epoch 1777/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 1778/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.5999e-04 - acc: 1.0000
    Epoch 1779/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1780/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1781/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1782/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 6.1810e-04 - acc: 1.0000
    Epoch 1783/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.7116e-04 - acc: 1.0000
    Epoch 1784/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1785/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1786/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.1769e-04 - acc: 1.0000
    Epoch 1787/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1788/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0029 - acc: 0.9996
    Epoch 1789/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1790/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0021 - acc: 0.9992
    Epoch 1791/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.8087e-04 - acc: 1.0000
    Epoch 1792/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1793/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.6901e-04 - acc: 1.0000
    Epoch 1794/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1795/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 0.9992
    Epoch 1796/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1797/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.3719e-04 - acc: 1.0000
    Epoch 1798/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.8202e-04 - acc: 1.0000
    Epoch 1799/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 7.2408e-04 - acc: 1.0000
    Epoch 1800/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.9496e-04 - acc: 1.0000
    Epoch 1801/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.0101e-04 - acc: 1.0000
    Epoch 1802/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1803/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0010 - acc: 0.9996
    Epoch 1804/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 7.4451e-04 - acc: 1.0000
    Epoch 1805/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.2573e-04 - acc: 1.0000
    Epoch 1806/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0041 - acc: 0.9996
    Epoch 1807/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.3491e-04 - acc: 1.0000
    Epoch 1808/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.4526e-04 - acc: 1.0000
    Epoch 1809/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 7.7669e-04 - acc: 1.0000
    Epoch 1810/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.4809e-04 - acc: 0.9996
    Epoch 1811/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1812/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.0752e-04 - acc: 1.0000
    Epoch 1813/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.2613e-04 - acc: 1.0000
    Epoch 1814/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1815/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.9256e-04 - acc: 1.0000
    Epoch 1816/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.0672e-04 - acc: 1.0000
    Epoch 1817/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1818/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.2731e-04 - acc: 1.0000
    Epoch 1819/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.5249e-04 - acc: 1.0000
    Epoch 1820/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.8677e-04 - acc: 1.0000
    Epoch 1821/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.9199e-04 - acc: 1.0000
    Epoch 1822/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.8890e-04 - acc: 1.0000
    Epoch 1823/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.6146e-04 - acc: 1.0000
    Epoch 1824/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.7154e-04 - acc: 1.0000
    Epoch 1825/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1826/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.6266e-04 - acc: 1.0000
    Epoch 1827/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.8553e-04 - acc: 1.0000
    Epoch 1828/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.9437e-04 - acc: 1.0000
    Epoch 1829/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 1830/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 1831/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 0.9996
    Epoch 1832/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.9614e-04 - acc: 1.0000
    Epoch 1833/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.0933e-04 - acc: 1.0000
    Epoch 1834/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.3952e-04 - acc: 1.0000
    Epoch 1835/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 5.8319e-04 - acc: 1.0000
    Epoch 1836/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 1837/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.9919e-04 - acc: 1.0000
    Epoch 1838/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.2815e-04 - acc: 1.0000
    Epoch 1839/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.7893e-04 - acc: 0.9996
    Epoch 1840/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 1841/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.7779e-04 - acc: 1.0000
    Epoch 1842/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 1843/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.0481e-04 - acc: 1.0000
    Epoch 1844/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.9593e-04 - acc: 1.0000
    Epoch 1845/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 4.9888e-04 - acc: 1.0000
    Epoch 1846/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 0.9992
    Epoch 1847/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.1638e-04 - acc: 1.0000
    Epoch 1848/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.9698e-04 - acc: 1.0000
    Epoch 1849/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.0498e-04 - acc: 1.0000
    Epoch 1850/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 5.5472e-04 - acc: 1.0000
    Epoch 1851/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.3602e-04 - acc: 1.0000
    Epoch 1852/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.4591e-04 - acc: 1.0000
    Epoch 1853/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.2788e-04 - acc: 1.0000
    Epoch 1854/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.6137e-04 - acc: 1.0000
    Epoch 1855/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 5.8548e-04 - acc: 1.0000
    Epoch 1856/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.7821e-04 - acc: 1.0000
    Epoch 1857/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.3202e-04 - acc: 1.0000
    Epoch 1858/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.1505e-04 - acc: 1.0000
    Epoch 1859/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 0.9992
    Epoch 1860/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.0550e-04 - acc: 1.0000
    Epoch 1861/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.9271e-04 - acc: 1.0000
    Epoch 1862/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.9697e-04 - acc: 1.0000
    Epoch 1863/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 4.5925e-04 - acc: 1.0000
    Epoch 1864/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.5183e-04 - acc: 1.0000
    Epoch 1865/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.9997e-04 - acc: 1.0000
    Epoch 1866/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.3274e-04 - acc: 0.9996
    Epoch 1867/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 1868/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.7543e-04 - acc: 1.0000
    Epoch 1869/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.5239e-04 - acc: 1.0000
    Epoch 1870/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1871/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 0.9992
    Epoch 1872/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.3618e-04 - acc: 0.9996
    Epoch 1873/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.7311e-04 - acc: 1.0000
    Epoch 1874/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.0354e-04 - acc: 1.0000
    Epoch 1875/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.4214e-04 - acc: 1.0000
    Epoch 1876/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.7667e-04 - acc: 1.0000
    Epoch 1877/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.9104e-04 - acc: 0.9996
    Epoch 1878/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.4920e-04 - acc: 1.0000
    Epoch 1879/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1880/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.6653e-04 - acc: 1.0000
    Epoch 1881/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.4279e-04 - acc: 1.0000
    Epoch 1882/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.3356e-04 - acc: 1.0000
    Epoch 1883/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0010 - acc: 0.9996
    Epoch 1884/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.7156e-04 - acc: 1.0000
    Epoch 1885/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.3592e-04 - acc: 1.0000
    Epoch 1886/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 4.6435e-04 - acc: 1.0000
    Epoch 1887/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.3552e-04 - acc: 1.0000
    Epoch 1888/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0012 - acc: 0.9992
    Epoch 1889/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.1559e-04 - acc: 1.0000
    Epoch 1890/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.9178e-04 - acc: 1.0000
    Epoch 1891/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.8871e-04 - acc: 1.0000
    Epoch 1892/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.6237e-04 - acc: 1.0000
    Epoch 1893/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0010 - acc: 0.9996
    Epoch 1894/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 4.3488e-04 - acc: 1.0000
    Epoch 1895/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.2574e-04 - acc: 1.0000
    Epoch 1896/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.3527e-04 - acc: 1.0000
    Epoch 1897/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.3566e-04 - acc: 1.0000
    Epoch 1898/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 4.3878e-04 - acc: 1.0000
    Epoch 1899/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 4.1834e-04 - acc: 1.0000
    Epoch 1900/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.9061e-04 - acc: 1.0000
    Epoch 1901/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.8466e-04 - acc: 1.0000
    Epoch 1902/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.1585e-04 - acc: 1.0000
    Epoch 1903/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.9952e-04 - acc: 1.0000
    Epoch 1904/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.5194e-04 - acc: 1.0000
    Epoch 1905/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.1057e-04 - acc: 1.0000
    Epoch 1906/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 1907/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1908/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.2996e-04 - acc: 1.0000
    Epoch 1909/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.3433e-04 - acc: 1.0000
    Epoch 1910/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 1911/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.1505e-04 - acc: 1.0000
    Epoch 1912/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.5986e-04 - acc: 1.0000
    Epoch 1913/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 6.1070e-04 - acc: 1.0000
    Epoch 1914/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.3085e-04 - acc: 1.0000
    Epoch 1915/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 4.3815e-04 - acc: 1.0000
    Epoch 1916/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.5793e-04 - acc: 0.9996
    Epoch 1917/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.6329e-04 - acc: 1.0000
    Epoch 1918/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.6758e-04 - acc: 1.0000
    Epoch 1919/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1920/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.1564e-04 - acc: 1.0000
    Epoch 1921/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.5518e-04 - acc: 1.0000
    Epoch 1922/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.5657e-04 - acc: 1.0000
    Epoch 1923/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.7011e-04 - acc: 0.9996
    Epoch 1924/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 3.7965e-04 - acc: 1.0000
    Epoch 1925/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.5533e-04 - acc: 1.0000
    Epoch 1926/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.6278e-04 - acc: 0.9996
    Epoch 1927/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 1928/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.5040e-04 - acc: 0.9996
    Epoch 1929/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.5243e-04 - acc: 1.0000
    Epoch 1930/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.3572e-04 - acc: 1.0000
    Epoch 1931/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 1932/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.0958e-04 - acc: 1.0000
    Epoch 1933/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.8011e-04 - acc: 1.0000
    Epoch 1934/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 1935/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0073 - acc: 0.9984
    Epoch 1936/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0115 - acc: 0.9973
    Epoch 1937/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0040 - acc: 0.9988
    Epoch 1938/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0184 - acc: 0.9965
    Epoch 1939/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0078 - acc: 0.9977
    Epoch 1940/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0168 - acc: 0.9961
    Epoch 1941/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0098 - acc: 0.9977
    Epoch 1942/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0051 - acc: 0.9992
    Epoch 1943/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0077 - acc: 0.9984
    Epoch 1944/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0242 - acc: 0.9922
    Epoch 1945/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0080 - acc: 0.9977
    Epoch 1946/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0113 - acc: 0.9965
    Epoch 1947/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.0073 - acc: 0.9980
    Epoch 1948/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0145 - acc: 0.9961
    Epoch 1949/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0096 - acc: 0.9973
    Epoch 1950/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0082 - acc: 0.9969
    Epoch 1951/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0090 - acc: 0.9977
    Epoch 1952/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0085 - acc: 0.9980
    Epoch 1953/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0050 - acc: 0.9988
    Epoch 1954/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0083 - acc: 0.9973
    Epoch 1955/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0049 - acc: 0.9988
    Epoch 1956/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0066 - acc: 0.9977
    Epoch 1957/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 1958/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0037 - acc: 1.0000
    Epoch 1959/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0030 - acc: 0.9996
    Epoch 1960/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0077 - acc: 0.9988
    Epoch 1961/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0038 - acc: 0.9988
    Epoch 1962/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 1963/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 1.0000
    Epoch 1964/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 1965/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0019 - acc: 0.9992
    Epoch 1966/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 1967/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0039 - acc: 0.9992
    Epoch 1968/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0028 - acc: 1.0000
    Epoch 1969/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 1970/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 1971/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 1972/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 1973/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1974/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 8.9189e-04 - acc: 1.0000
    Epoch 1975/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 1976/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 1977/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1978/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.9670e-04 - acc: 1.0000
    Epoch 1979/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 7.4405e-04 - acc: 1.0000
    Epoch 1980/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.5483e-04 - acc: 1.0000
    Epoch 1981/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 1982/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.0714e-04 - acc: 1.0000
    Epoch 1983/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.3435e-04 - acc: 1.0000
    Epoch 1984/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.0393e-04 - acc: 1.0000
    Epoch 1985/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.4377e-04 - acc: 1.0000
    Epoch 1986/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.7291e-04 - acc: 1.0000
    Epoch 1987/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.2897e-04 - acc: 1.0000
    Epoch 1988/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.5694e-04 - acc: 0.9996
    Epoch 1989/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 4.9326e-04 - acc: 1.0000
    Epoch 1990/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.0517e-04 - acc: 1.0000
    Epoch 1991/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.0948e-04 - acc: 1.0000
    Epoch 1992/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 1993/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.7195e-04 - acc: 1.0000
    Epoch 1994/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 1995/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 1996/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.2475e-04 - acc: 1.0000
    Epoch 1997/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.5764e-04 - acc: 1.0000
    Epoch 1998/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 9.0369e-04 - acc: 0.9996
    Epoch 1999/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 9.0089e-04 - acc: 1.0000
    Epoch 2000/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2001/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.3405e-04 - acc: 1.0000
    Epoch 2002/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 7.1212e-04 - acc: 1.0000
    Epoch 2003/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.9957e-04 - acc: 1.0000
    Epoch 2004/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 7.0278e-04 - acc: 1.0000
    Epoch 2005/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.7117e-04 - acc: 1.0000
    Epoch 2006/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 5.9739e-04 - acc: 1.0000
    Epoch 2007/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.1911e-04 - acc: 1.0000
    Epoch 2008/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.6213e-04 - acc: 1.0000
    Epoch 2009/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.0670e-04 - acc: 1.0000
    Epoch 2010/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.8109e-04 - acc: 1.0000
    Epoch 2011/3000
    2559/2559 [==============================] - 27s 11ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 2012/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.1069e-04 - acc: 0.9996
    Epoch 2013/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.1074e-04 - acc: 1.0000
    Epoch 2014/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.1794e-04 - acc: 1.0000
    Epoch 2015/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.6889e-04 - acc: 1.0000
    Epoch 2016/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 6.6935e-04 - acc: 1.0000
    Epoch 2017/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.0644e-04 - acc: 1.0000
    Epoch 2018/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 4.0613e-04 - acc: 1.0000
    Epoch 2019/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.9580e-04 - acc: 1.0000
    Epoch 2020/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 5.4700e-04 - acc: 1.0000
    Epoch 2021/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 2022/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 2023/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 5.3155e-04 - acc: 1.0000
    Epoch 2024/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.3881e-04 - acc: 1.0000
    Epoch 2025/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.7615e-04 - acc: 1.0000
    Epoch 2026/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 5.0207e-04 - acc: 1.0000
    Epoch 2027/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.6160e-04 - acc: 1.0000
    Epoch 2028/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.0008e-04 - acc: 1.0000
    Epoch 2029/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 8.4608e-04 - acc: 0.9996
    Epoch 2030/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.9834e-04 - acc: 1.0000
    Epoch 2031/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 7.1429e-04 - acc: 1.0000
    Epoch 2032/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2033/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.2613e-04 - acc: 1.0000
    Epoch 2034/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.6740e-04 - acc: 1.0000
    Epoch 2035/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.3197e-04 - acc: 1.0000
    Epoch 2036/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.6637e-04 - acc: 1.0000
    Epoch 2037/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.1765e-04 - acc: 1.0000
    Epoch 2038/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 0.9992
    Epoch 2039/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.8057e-04 - acc: 1.0000
    Epoch 2040/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.5758e-04 - acc: 1.0000
    Epoch 2041/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.3201e-04 - acc: 1.0000
    Epoch 2042/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.0198e-04 - acc: 1.0000
    Epoch 2043/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.5333e-04 - acc: 1.0000
    Epoch 2044/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.9113e-04 - acc: 1.0000
    Epoch 2045/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.6991e-04 - acc: 1.0000
    Epoch 2046/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0022 - acc: 0.9992
    Epoch 2047/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.6565e-04 - acc: 1.0000
    Epoch 2048/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.7593e-04 - acc: 1.0000
    Epoch 2049/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.8001e-04 - acc: 1.0000
    Epoch 2050/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.8709e-04 - acc: 1.0000
    Epoch 2051/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 7.2509e-04 - acc: 1.0000
    Epoch 2052/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.9397e-04 - acc: 1.0000
    Epoch 2053/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.4773e-04 - acc: 0.9996
    Epoch 2054/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.7463e-04 - acc: 1.0000
    Epoch 2055/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.5901e-04 - acc: 0.9996
    Epoch 2056/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 2.9830e-04 - acc: 1.0000
    Epoch 2057/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.4278e-04 - acc: 1.0000
    Epoch 2058/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.3241e-04 - acc: 1.0000
    Epoch 2059/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.4832e-04 - acc: 0.9996
    Epoch 2060/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.7365e-04 - acc: 0.9996
    Epoch 2061/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 3.8576e-04 - acc: 1.0000
    Epoch 2062/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.0723e-04 - acc: 1.0000
    Epoch 2063/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2064/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 7.3382e-04 - acc: 1.0000
    Epoch 2065/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.5014e-04 - acc: 1.0000
    Epoch 2066/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.1144e-04 - acc: 1.0000
    Epoch 2067/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.3959e-04 - acc: 1.0000
    Epoch 2068/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.8340e-04 - acc: 1.0000
    Epoch 2069/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 0.9996
    Epoch 2070/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.6809e-04 - acc: 1.0000
    Epoch 2071/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.0162e-04 - acc: 0.9996
    Epoch 2072/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.6343e-04 - acc: 1.0000
    Epoch 2073/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.6705e-04 - acc: 1.0000
    Epoch 2074/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.7570e-04 - acc: 1.0000
    Epoch 2075/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 4.6762e-04 - acc: 1.0000
    Epoch 2076/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.2890e-04 - acc: 0.9996
    Epoch 2077/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.8429e-04 - acc: 1.0000
    Epoch 2078/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 8.7331e-04 - acc: 0.9996
    Epoch 2079/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.7242e-04 - acc: 1.0000
    Epoch 2080/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.8633e-04 - acc: 1.0000
    Epoch 2081/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.9681e-04 - acc: 1.0000
    Epoch 2082/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.4610e-04 - acc: 1.0000
    Epoch 2083/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.2846e-04 - acc: 0.9996
    Epoch 2084/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 4.9534e-04 - acc: 1.0000
    Epoch 2085/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.5115e-04 - acc: 1.0000
    Epoch 2086/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.8921e-04 - acc: 1.0000
    Epoch 2087/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.8637e-04 - acc: 1.0000
    Epoch 2088/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.4270e-04 - acc: 1.0000
    Epoch 2089/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.6352e-04 - acc: 1.0000
    Epoch 2090/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.1949e-04 - acc: 1.0000
    Epoch 2091/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.8229e-04 - acc: 1.0000
    Epoch 2092/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 4.3893e-04 - acc: 1.0000
    Epoch 2093/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.0562e-04 - acc: 1.0000
    Epoch 2094/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.6471e-04 - acc: 1.0000
    Epoch 2095/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.9966e-04 - acc: 0.9996
    Epoch 2096/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 2097/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 3.9774e-04 - acc: 1.0000
    Epoch 2098/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.9621e-04 - acc: 1.0000
    Epoch 2099/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.9997e-04 - acc: 1.0000
    Epoch 2100/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.8429e-04 - acc: 1.0000
    Epoch 2101/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.8353e-04 - acc: 1.0000
    Epoch 2102/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 6.3576e-04 - acc: 0.9996
    Epoch 2103/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 7.0730e-04 - acc: 0.9996
    Epoch 2104/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.6767e-04 - acc: 1.0000
    Epoch 2105/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.8621e-04 - acc: 1.0000
    Epoch 2106/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 7.9386e-04 - acc: 1.0000
    Epoch 2107/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.7271e-04 - acc: 1.0000
    Epoch 2108/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 4.7450e-04 - acc: 1.0000
    Epoch 2109/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 4.2197e-04 - acc: 1.0000
    Epoch 2110/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.8216e-04 - acc: 1.0000
    Epoch 2111/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.0396e-04 - acc: 1.0000
    Epoch 2112/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 0.9988
    Epoch 2113/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.1775e-04 - acc: 1.0000
    Epoch 2114/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.8697e-04 - acc: 0.9996
    Epoch 2115/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2116/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0019 - acc: 0.9992
    Epoch 2117/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.2088e-04 - acc: 1.0000
    Epoch 2118/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 2119/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 0.9992
    Epoch 2120/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.0695e-04 - acc: 1.0000
    Epoch 2121/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 2122/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 9.5081e-04 - acc: 0.9996
    Epoch 2123/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 8.8937e-04 - acc: 1.0000
    Epoch 2124/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 7.0384e-04 - acc: 1.0000
    Epoch 2125/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.0459e-04 - acc: 1.0000
    Epoch 2126/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.7699e-04 - acc: 1.0000
    Epoch 2127/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.9886e-04 - acc: 1.0000
    Epoch 2128/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 5.4367e-04 - acc: 1.0000
    Epoch 2129/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.5776e-04 - acc: 1.0000
    Epoch 2130/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.1278e-04 - acc: 1.0000
    Epoch 2131/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.5525e-04 - acc: 1.0000
    Epoch 2132/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.5815e-04 - acc: 1.0000
    Epoch 2133/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 2134/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.3166e-04 - acc: 1.0000
    Epoch 2135/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.1764e-04 - acc: 1.0000
    Epoch 2136/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.7888e-04 - acc: 1.0000
    Epoch 2137/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 8.0301e-04 - acc: 0.9996
    Epoch 2138/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 2139/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.5018e-04 - acc: 1.0000
    Epoch 2140/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.8554e-04 - acc: 1.0000
    Epoch 2141/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0031 - acc: 0.9996
    Epoch 2142/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.9769e-04 - acc: 1.0000
    Epoch 2143/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.6091e-04 - acc: 0.9996
    Epoch 2144/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.9931e-04 - acc: 1.0000
    Epoch 2145/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 2146/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.9089e-04 - acc: 1.0000
    Epoch 2147/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 2148/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.6585e-04 - acc: 1.0000
    Epoch 2149/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.2496e-04 - acc: 1.0000
    Epoch 2150/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.3294e-04 - acc: 1.0000
    Epoch 2151/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.3902e-04 - acc: 1.0000
    Epoch 2152/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 8.5696e-04 - acc: 0.9996
    Epoch 2153/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.4247e-04 - acc: 1.0000
    Epoch 2154/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0016 - acc: 0.9992
    Epoch 2155/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.5616e-04 - acc: 1.0000
    Epoch 2156/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 2157/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.1680e-04 - acc: 1.0000
    Epoch 2158/3000
    2559/2559 [==============================] - 27s 10ms/step - loss: 6.9924e-04 - acc: 1.0000
    Epoch 2159/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.7609e-04 - acc: 1.0000
    Epoch 2160/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0032 - acc: 0.9996
    Epoch 2161/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.1637e-04 - acc: 0.9996
    Epoch 2162/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 2.4610e-04 - acc: 1.0000
    Epoch 2163/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.9991e-04 - acc: 1.0000
    Epoch 2164/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.5037e-04 - acc: 1.0000
    Epoch 2165/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.1355e-04 - acc: 1.0000
    Epoch 2166/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 6.9078e-04 - acc: 0.9996
    Epoch 2167/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.1539e-04 - acc: 1.0000
    Epoch 2168/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.1537e-04 - acc: 0.9996
    Epoch 2169/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.2605e-04 - acc: 1.0000
    Epoch 2170/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.0487e-04 - acc: 1.0000
    Epoch 2171/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.5512e-04 - acc: 1.0000
    Epoch 2172/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.5260e-04 - acc: 0.9996
    Epoch 2173/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.1136e-04 - acc: 1.0000
    Epoch 2174/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 3.3362e-04 - acc: 1.0000
    Epoch 2175/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.4707e-04 - acc: 0.9996
    Epoch 2176/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 7.2582e-04 - acc: 1.0000
    Epoch 2177/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.3667e-04 - acc: 0.9996
    Epoch 2178/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.0806e-04 - acc: 0.9996
    Epoch 2179/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.6615e-04 - acc: 1.0000
    Epoch 2180/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 2181/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 3.6463e-04 - acc: 1.0000
    Epoch 2182/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.8225e-04 - acc: 1.0000
    Epoch 2183/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.8527e-04 - acc: 1.0000
    Epoch 2184/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 8.7552e-04 - acc: 1.0000
    Epoch 2185/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.1343e-04 - acc: 1.0000
    Epoch 2186/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 7.5163e-04 - acc: 1.0000
    Epoch 2187/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.5331e-04 - acc: 1.0000
    Epoch 2188/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.4246e-04 - acc: 1.0000
    Epoch 2189/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 2190/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0030 - acc: 0.9992
    Epoch 2191/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0019 - acc: 0.9992
    Epoch 2192/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.3382e-04 - acc: 1.0000
    Epoch 2193/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 0.9992
    Epoch 2194/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.6283e-04 - acc: 1.0000
    Epoch 2195/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.0875e-04 - acc: 1.0000
    Epoch 2196/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.1705e-04 - acc: 0.9996
    Epoch 2197/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.4133e-04 - acc: 1.0000
    Epoch 2198/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.5338e-04 - acc: 1.0000
    Epoch 2199/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.0703e-04 - acc: 1.0000
    Epoch 2200/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.1512e-04 - acc: 1.0000
    Epoch 2201/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.9924e-04 - acc: 1.0000
    Epoch 2202/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0014 - acc: 0.9992
    Epoch 2203/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.4850e-04 - acc: 1.0000
    Epoch 2204/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2205/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 2206/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 2207/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 4.7551e-04 - acc: 1.0000
    Epoch 2208/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0041 - acc: 0.9992
    Epoch 2209/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0045 - acc: 0.9984
    Epoch 2210/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0082 - acc: 0.9977
    Epoch 2211/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0297 - acc: 0.9894
    Epoch 2212/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.5224 - acc: 0.9082
    Epoch 2213/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 1.5167 - acc: 0.7831
    Epoch 2214/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 1.0301 - acc: 0.8331
    Epoch 2215/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.9797 - acc: 0.8335
    Epoch 2216/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 1.1142 - acc: 0.7999
    Epoch 2217/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.9103 - acc: 0.8222
    Epoch 2218/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.6220 - acc: 0.8574
    Epoch 2219/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.6572 - acc: 0.8449
    Epoch 2220/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.4657 - acc: 0.8753
    Epoch 2221/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.4695 - acc: 0.8683
    Epoch 2222/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.3819 - acc: 0.8855
    Epoch 2223/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.3436 - acc: 0.8949
    Epoch 2224/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.3003 - acc: 0.9050
    Epoch 2225/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.2520 - acc: 0.9086
    Epoch 2226/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.2176 - acc: 0.9254
    Epoch 2227/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1884 - acc: 0.9281
    Epoch 2228/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1630 - acc: 0.9402
    Epoch 2229/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1396 - acc: 0.9472
    Epoch 2230/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1273 - acc: 0.9488
    Epoch 2231/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.1208 - acc: 0.9578
    Epoch 2232/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0951 - acc: 0.9652
    Epoch 2233/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0815 - acc: 0.9707
    Epoch 2234/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0885 - acc: 0.9672
    Epoch 2235/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0671 - acc: 0.9797
    Epoch 2236/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0617 - acc: 0.9801
    Epoch 2237/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0535 - acc: 0.9848
    Epoch 2238/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0503 - acc: 0.9875
    Epoch 2239/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0453 - acc: 0.9887
    Epoch 2240/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0413 - acc: 0.9918
    Epoch 2241/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0348 - acc: 0.9949
    Epoch 2242/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0299 - acc: 0.9949
    Epoch 2243/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0279 - acc: 0.9965
    Epoch 2244/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0275 - acc: 0.9973
    Epoch 2245/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0245 - acc: 0.9980
    Epoch 2246/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0232 - acc: 0.9984
    Epoch 2247/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0199 - acc: 0.9992
    Epoch 2248/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0190 - acc: 0.9992
    Epoch 2249/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0182 - acc: 0.9996
    Epoch 2250/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0182 - acc: 0.9988
    Epoch 2251/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0168 - acc: 0.9988
    Epoch 2252/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0163 - acc: 0.9992
    Epoch 2253/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0149 - acc: 0.9992
    Epoch 2254/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0143 - acc: 0.9996
    Epoch 2255/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0133 - acc: 0.9996
    Epoch 2256/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0137 - acc: 0.9988
    Epoch 2257/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0136 - acc: 0.9988
    Epoch 2258/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0121 - acc: 0.9988
    Epoch 2259/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0119 - acc: 0.9992
    Epoch 2260/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0110 - acc: 0.9992
    Epoch 2261/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0115 - acc: 0.9988
    Epoch 2262/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0117 - acc: 0.9992
    Epoch 2263/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0102 - acc: 0.9992
    Epoch 2264/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0131 - acc: 0.9980
    Epoch 2265/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0092 - acc: 0.9996
    Epoch 2266/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0095 - acc: 0.9992
    Epoch 2267/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0101 - acc: 0.9988
    Epoch 2268/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0116 - acc: 0.9984
    Epoch 2269/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0088 - acc: 0.9996
    Epoch 2270/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0098 - acc: 0.9984
    Epoch 2271/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0090 - acc: 0.9992
    Epoch 2272/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0087 - acc: 0.9992
    Epoch 2273/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0076 - acc: 0.9996
    Epoch 2274/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0074 - acc: 0.9992
    Epoch 2275/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0075 - acc: 0.9996
    Epoch 2276/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0075 - acc: 0.9996
    Epoch 2277/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0073 - acc: 0.9992
    Epoch 2278/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0076 - acc: 0.9992
    Epoch 2279/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0066 - acc: 0.9996
    Epoch 2280/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0067 - acc: 0.9992
    Epoch 2281/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0069 - acc: 0.9996
    Epoch 2282/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0068 - acc: 0.9992
    Epoch 2283/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0062 - acc: 0.9996
    Epoch 2284/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0075 - acc: 0.9992
    Epoch 2285/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0068 - acc: 0.9992
    Epoch 2286/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0062 - acc: 0.9992
    Epoch 2287/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0055 - acc: 1.0000
    Epoch 2288/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 0.0054 - acc: 1.0000
    Epoch 2289/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0055 - acc: 1.0000
    Epoch 2290/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.0055 - acc: 0.9996
    Epoch 2291/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0064 - acc: 0.9992
    Epoch 2292/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0055 - acc: 0.9996
    Epoch 2293/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0052 - acc: 0.9996
    Epoch 2294/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0050 - acc: 1.0000
    Epoch 2295/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0062 - acc: 0.9992
    Epoch 2296/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0053 - acc: 0.9996
    Epoch 2297/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0057 - acc: 0.9992
    Epoch 2298/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0048 - acc: 1.0000
    Epoch 2299/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0054 - acc: 0.9996
    Epoch 2300/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0047 - acc: 0.9996
    Epoch 2301/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0043 - acc: 1.0000
    Epoch 2302/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0043 - acc: 1.0000
    Epoch 2303/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0051 - acc: 0.9996
    Epoch 2304/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0047 - acc: 0.9996
    Epoch 2305/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0049 - acc: 0.9996
    Epoch 2306/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0045 - acc: 1.0000
    Epoch 2307/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0047 - acc: 0.9996
    Epoch 2308/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0054 - acc: 0.9996
    Epoch 2309/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0043 - acc: 1.0000
    Epoch 2310/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0042 - acc: 0.9996
    Epoch 2311/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0041 - acc: 1.0000
    Epoch 2312/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0045 - acc: 0.9992
    Epoch 2313/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0037 - acc: 1.0000
    Epoch 2314/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0038 - acc: 1.0000
    Epoch 2315/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0045 - acc: 0.9996
    Epoch 2316/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0047 - acc: 0.9996
    Epoch 2317/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0038 - acc: 1.0000
    Epoch 2318/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0037 - acc: 1.0000
    Epoch 2319/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0054 - acc: 0.9996
    Epoch 2320/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0040 - acc: 0.9996
    Epoch 2321/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0037 - acc: 0.9996
    Epoch 2322/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0038 - acc: 0.9996
    Epoch 2323/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0042 - acc: 0.9996
    Epoch 2324/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0032 - acc: 1.0000
    Epoch 2325/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0033 - acc: 1.0000
    Epoch 2326/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0035 - acc: 0.9996
    Epoch 2327/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0045 - acc: 0.9996
    Epoch 2328/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0052 - acc: 0.9992
    Epoch 2329/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0040 - acc: 0.9992
    Epoch 2330/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0033 - acc: 0.9996
    Epoch 2331/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0040 - acc: 0.9996
    Epoch 2332/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0035 - acc: 0.9996
    Epoch 2333/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0036 - acc: 0.9996
    Epoch 2334/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0031 - acc: 1.0000
    Epoch 2335/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0052 - acc: 0.9984
    Epoch 2336/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0032 - acc: 1.0000
    Epoch 2337/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0031 - acc: 1.0000
    Epoch 2338/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0033 - acc: 1.0000
    Epoch 2339/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0034 - acc: 0.9996
    Epoch 2340/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0033 - acc: 1.0000
    Epoch 2341/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0031 - acc: 1.0000
    Epoch 2342/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0033 - acc: 1.0000
    Epoch 2343/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0040 - acc: 0.9996
    Epoch 2344/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0027 - acc: 1.0000
    Epoch 2345/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0029 - acc: 1.0000
    Epoch 2346/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0033 - acc: 1.0000
    Epoch 2347/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 1.0000
    Epoch 2348/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0036 - acc: 0.9992
    Epoch 2349/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0027 - acc: 1.0000
    Epoch 2350/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0030 - acc: 0.9996
    Epoch 2351/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0026 - acc: 1.0000
    Epoch 2352/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 2353/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0032 - acc: 0.9992
    Epoch 2354/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0030 - acc: 0.9996
    Epoch 2355/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0026 - acc: 1.0000
    Epoch 2356/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 2357/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0029 - acc: 1.0000
    Epoch 2358/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0043 - acc: 0.9988
    Epoch 2359/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 2360/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 2361/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 2362/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 2363/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 2364/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 2365/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0032 - acc: 0.9996
    Epoch 2366/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 2367/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 2368/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 2369/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0025 - acc: 1.0000
    Epoch 2370/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 2371/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 2372/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 2373/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0027 - acc: 0.9996
    Epoch 2374/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 2375/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 2376/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0026 - acc: 1.0000
    Epoch 2377/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 2378/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 2379/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 2380/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0032 - acc: 0.9988
    Epoch 2381/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 2382/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0025 - acc: 0.9996
    Epoch 2383/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 2384/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 2385/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 2386/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0029 - acc: 0.9996
    Epoch 2387/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0029 - acc: 0.9996
    Epoch 2388/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 2389/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 2390/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 2391/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0028 - acc: 0.9992
    Epoch 2392/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 2393/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 2394/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0029 - acc: 0.9996
    Epoch 2395/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0033 - acc: 0.9992
    Epoch 2396/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0034 - acc: 0.9992
    Epoch 2397/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0026 - acc: 0.9996
    Epoch 2398/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 1.0000
    Epoch 2399/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 2400/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0023 - acc: 1.0000
    Epoch 2401/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0032 - acc: 0.9996
    Epoch 2402/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0022 - acc: 1.0000
    Epoch 2403/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0025 - acc: 0.9996
    Epoch 2404/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 2405/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 2406/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 2407/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 2408/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 2409/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0021 - acc: 1.0000
    Epoch 2410/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 2411/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 2412/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 2413/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 2414/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 2415/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 2416/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 2417/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 2418/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2419/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 2420/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 2421/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 2422/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2423/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2424/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2425/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 2426/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2427/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2428/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 2429/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2430/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 2431/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 2432/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 2433/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 2434/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2435/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2436/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 2437/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 2438/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2439/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0019 - acc: 1.0000
    Epoch 2440/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2441/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0038 - acc: 0.9992
    Epoch 2442/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 2443/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2444/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2445/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2446/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2447/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2448/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2449/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2450/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0028 - acc: 0.9992
    Epoch 2451/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2452/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 1.0000
    Epoch 2453/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2454/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2455/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2456/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 2457/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0033 - acc: 0.9988
    Epoch 2458/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0023 - acc: 0.9992
    Epoch 2459/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2460/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 2461/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0029 - acc: 0.9996
    Epoch 2462/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0050 - acc: 0.9992
    Epoch 2463/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0030 - acc: 0.9988
    Epoch 2464/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 2465/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 2466/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 2467/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 2468/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 2469/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 2470/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0049 - acc: 0.9988
    Epoch 2471/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 2472/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0029 - acc: 0.9992
    Epoch 2473/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 2474/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0022 - acc: 0.9996
    Epoch 2475/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2476/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2477/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0030 - acc: 0.9992
    Epoch 2478/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2479/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0025 - acc: 0.9996
    Epoch 2480/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2481/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 2482/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 2483/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2484/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2485/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 0.9992
    Epoch 2486/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 2487/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2488/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2489/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2490/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2491/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2492/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 0.9992
    Epoch 2493/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 2494/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 2495/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2496/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0016 - acc: 1.0000
    Epoch 2497/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 2498/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2499/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 9.4855e-04 - acc: 1.0000
    Epoch 2500/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2501/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 2502/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2503/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 2504/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2505/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0020 - acc: 0.9992
    Epoch 2506/3000
    2559/2559 [==============================] - 24s 10ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2507/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2508/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.2594e-04 - acc: 1.0000
    Epoch 2509/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2510/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2511/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2512/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2513/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 2514/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2515/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 2516/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2517/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.0344e-04 - acc: 1.0000
    Epoch 2518/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2519/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.2666e-04 - acc: 1.0000
    Epoch 2520/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2521/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0018 - acc: 0.9992
    Epoch 2522/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2523/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2524/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2525/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 2526/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 2527/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 2528/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 2529/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0015 - acc: 1.0000
    Epoch 2530/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0023 - acc: 0.9992
    Epoch 2531/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2532/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 2533/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 2534/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2535/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2536/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2537/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2538/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 2539/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 1.0000
    Epoch 2540/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 2541/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 2542/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 2543/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 8.8118e-04 - acc: 1.0000
    Epoch 2544/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 2545/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2546/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0018 - acc: 0.9992
    Epoch 2547/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2548/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2549/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2550/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.4943e-04 - acc: 1.0000
    Epoch 2551/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 2552/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 7.9975e-04 - acc: 1.0000
    Epoch 2553/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.4880e-04 - acc: 1.0000
    Epoch 2554/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.0217e-04 - acc: 1.0000
    Epoch 2555/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.9892e-04 - acc: 1.0000
    Epoch 2556/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.8088e-04 - acc: 1.0000
    Epoch 2557/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2558/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.9081e-04 - acc: 1.0000
    Epoch 2559/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 2560/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0010 - acc: 0.9996
    Epoch 2561/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.5247e-04 - acc: 1.0000
    Epoch 2562/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2563/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 2564/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.1278e-04 - acc: 1.0000
    Epoch 2565/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 9.1543e-04 - acc: 1.0000
    Epoch 2566/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 2567/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 2568/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 9.9667e-04 - acc: 1.0000
    Epoch 2569/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.7464e-04 - acc: 1.0000
    Epoch 2570/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 2571/3000
    2559/2559 [==============================] - 28s 11ms/step - loss: 8.3015e-04 - acc: 1.0000
    Epoch 2572/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 8.3564e-04 - acc: 1.0000
    Epoch 2573/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2574/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2575/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 0.9992
    Epoch 2576/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 8.0935e-04 - acc: 1.0000
    Epoch 2577/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.3933e-04 - acc: 1.0000
    Epoch 2578/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 2579/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 8.2740e-04 - acc: 1.0000
    Epoch 2580/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2581/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2582/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2583/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 9.8861e-04 - acc: 1.0000
    Epoch 2584/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.5062e-04 - acc: 1.0000
    Epoch 2585/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 2586/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2587/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 2588/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2589/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2590/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 9.3338e-04 - acc: 1.0000
    Epoch 2591/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 8.5488e-04 - acc: 1.0000
    Epoch 2592/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.3729e-04 - acc: 1.0000
    Epoch 2593/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.6137e-04 - acc: 1.0000
    Epoch 2594/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2595/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 2596/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 8.1569e-04 - acc: 1.0000
    Epoch 2597/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2598/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0026 - acc: 0.9996
    Epoch 2599/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2600/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2601/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2602/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.4228e-04 - acc: 1.0000
    Epoch 2603/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2604/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0020 - acc: 0.9992
    Epoch 2605/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2606/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 2607/3000
    2559/2559 [==============================] - 24s 10ms/step - loss: 8.4777e-04 - acc: 1.0000
    Epoch 2608/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2609/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2610/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2611/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 1.0000
    Epoch 2612/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 2613/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.8293e-04 - acc: 1.0000
    Epoch 2614/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 7.5789e-04 - acc: 1.0000
    Epoch 2615/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.1703e-04 - acc: 1.0000
    Epoch 2616/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 7.5490e-04 - acc: 1.0000
    Epoch 2617/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 7.0829e-04 - acc: 1.0000
    Epoch 2618/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.1267e-04 - acc: 1.0000
    Epoch 2619/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.1555e-04 - acc: 1.0000
    Epoch 2620/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 8.3071e-04 - acc: 1.0000
    Epoch 2621/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.7661e-04 - acc: 1.0000
    Epoch 2622/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 6.6428e-04 - acc: 1.0000
    Epoch 2623/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.1389e-04 - acc: 1.0000
    Epoch 2624/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.4152e-04 - acc: 1.0000
    Epoch 2625/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 2626/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 6.9671e-04 - acc: 1.0000
    Epoch 2627/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 2628/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 7.7682e-04 - acc: 1.0000
    Epoch 2629/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2630/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0032 - acc: 0.9988
    Epoch 2631/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 8.7162e-04 - acc: 1.0000
    Epoch 2632/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 8.4102e-04 - acc: 1.0000
    Epoch 2633/3000
    2559/2559 [==============================] - 27s 11ms/step - loss: 9.4154e-04 - acc: 1.0000
    Epoch 2634/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.0650e-04 - acc: 1.0000
    Epoch 2635/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 9.1328e-04 - acc: 1.0000
    Epoch 2636/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.4315e-04 - acc: 1.0000
    Epoch 2637/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 7.1005e-04 - acc: 1.0000
    Epoch 2638/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.4140e-04 - acc: 1.0000
    Epoch 2639/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 8.8167e-04 - acc: 1.0000
    Epoch 2640/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 7.4041e-04 - acc: 1.0000
    Epoch 2641/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 6.0780e-04 - acc: 1.0000
    Epoch 2642/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.0802e-04 - acc: 1.0000
    Epoch 2643/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 5.9767e-04 - acc: 1.0000
    Epoch 2644/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 2645/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.0854e-04 - acc: 1.0000
    Epoch 2646/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 8.8554e-04 - acc: 1.0000
    Epoch 2647/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0010 - acc: 1.0000
    Epoch 2648/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2649/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 2650/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0013 - acc: 0.9996
    Epoch 2651/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2652/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0019 - acc: 0.9992
    Epoch 2653/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.0425e-04 - acc: 1.0000
    Epoch 2654/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0029 - acc: 0.9988
    Epoch 2655/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.8103e-04 - acc: 1.0000
    Epoch 2656/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 8.0576e-04 - acc: 1.0000
    Epoch 2657/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2658/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0012 - acc: 1.0000
    Epoch 2659/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 8.8453e-04 - acc: 1.0000
    Epoch 2660/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 2661/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.0019 - acc: 0.9996
    Epoch 2662/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 9.9005e-04 - acc: 1.0000
    Epoch 2663/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.7235e-04 - acc: 1.0000
    Epoch 2664/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.6298e-04 - acc: 1.0000
    Epoch 2665/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 0.9992
    Epoch 2666/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 7.0427e-04 - acc: 1.0000
    Epoch 2667/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 2668/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.0808e-04 - acc: 1.0000
    Epoch 2669/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 7.0713e-04 - acc: 1.0000
    Epoch 2670/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 8.3668e-04 - acc: 1.0000
    Epoch 2671/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 7.8747e-04 - acc: 1.0000
    Epoch 2672/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2673/3000
    2559/2559 [==============================] - 24s 10ms/step - loss: 7.7689e-04 - acc: 1.0000
    Epoch 2674/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.5110e-04 - acc: 1.0000
    Epoch 2675/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.2407e-04 - acc: 1.0000
    Epoch 2676/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.8930e-04 - acc: 1.0000
    Epoch 2677/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 7.3043e-04 - acc: 1.0000
    Epoch 2678/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2679/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.8660e-04 - acc: 1.0000
    Epoch 2680/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.2646e-04 - acc: 1.0000
    Epoch 2681/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.4150e-04 - acc: 1.0000
    Epoch 2682/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.5976e-04 - acc: 1.0000
    Epoch 2683/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.0246e-04 - acc: 1.0000
    Epoch 2684/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2685/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.0247e-04 - acc: 1.0000
    Epoch 2686/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 5.2774e-04 - acc: 1.0000
    Epoch 2687/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 2688/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.3813e-04 - acc: 1.0000
    Epoch 2689/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.6237e-04 - acc: 1.0000
    Epoch 2690/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.1034e-04 - acc: 1.0000
    Epoch 2691/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 6.0099e-04 - acc: 1.0000
    Epoch 2692/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0012 - acc: 0.9996
    Epoch 2693/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.8166e-04 - acc: 1.0000
    Epoch 2694/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 9.9847e-04 - acc: 0.9996
    Epoch 2695/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 5.3459e-04 - acc: 1.0000
    Epoch 2696/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.2428e-04 - acc: 1.0000
    Epoch 2697/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.9027e-04 - acc: 1.0000
    Epoch 2698/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.3575e-04 - acc: 1.0000
    Epoch 2699/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.5380e-04 - acc: 1.0000
    Epoch 2700/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 8.1517e-04 - acc: 1.0000
    Epoch 2701/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 0.0016 - acc: 0.9992
    Epoch 2702/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 6.9093e-04 - acc: 1.0000
    Epoch 2703/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2704/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 8.2859e-04 - acc: 1.0000
    Epoch 2705/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.4252e-04 - acc: 1.0000
    Epoch 2706/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.9780e-04 - acc: 1.0000
    Epoch 2707/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.9610e-04 - acc: 1.0000
    Epoch 2708/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 7.1529e-04 - acc: 1.0000
    Epoch 2709/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.5668e-04 - acc: 1.0000
    Epoch 2710/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0017 - acc: 0.9992
    Epoch 2711/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 2712/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.7454e-04 - acc: 1.0000
    Epoch 2713/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.5627e-04 - acc: 1.0000
    Epoch 2714/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.0270e-04 - acc: 0.9996
    Epoch 2715/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 5.2511e-04 - acc: 1.0000
    Epoch 2716/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.3812e-04 - acc: 1.0000
    Epoch 2717/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.0705e-04 - acc: 1.0000
    Epoch 2718/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0018 - acc: 0.9992
    Epoch 2719/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 9.8250e-04 - acc: 0.9996
    Epoch 2720/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.6763e-04 - acc: 1.0000
    Epoch 2721/3000
    2559/2559 [==============================] - 22s 8ms/step - loss: 5.5082e-04 - acc: 1.0000
    Epoch 2722/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.1810e-04 - acc: 1.0000
    Epoch 2723/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.5088e-04 - acc: 1.0000
    Epoch 2724/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.9342e-04 - acc: 1.0000
    Epoch 2725/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.8921e-04 - acc: 0.9996
    Epoch 2726/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.6995e-04 - acc: 1.0000
    Epoch 2727/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.7692e-04 - acc: 1.0000
    Epoch 2728/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.8046e-04 - acc: 1.0000
    Epoch 2729/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.0204e-04 - acc: 1.0000
    Epoch 2730/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.8753e-04 - acc: 1.0000
    Epoch 2731/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.4975e-04 - acc: 1.0000
    Epoch 2732/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.2254e-04 - acc: 1.0000
    Epoch 2733/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.6614e-04 - acc: 0.9996
    Epoch 2734/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.5431e-04 - acc: 1.0000
    Epoch 2735/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.4017e-04 - acc: 1.0000
    Epoch 2736/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 4.6279e-04 - acc: 1.0000
    Epoch 2737/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 6.2030e-04 - acc: 1.0000
    Epoch 2738/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.8375e-04 - acc: 1.0000
    Epoch 2739/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.7437e-04 - acc: 1.0000
    Epoch 2740/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 7.2104e-04 - acc: 1.0000
    Epoch 2741/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 5.6135e-04 - acc: 1.0000
    Epoch 2742/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.1479e-04 - acc: 1.0000
    Epoch 2743/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 4.9089e-04 - acc: 1.0000
    Epoch 2744/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.1577e-04 - acc: 1.0000
    Epoch 2745/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.5822e-04 - acc: 1.0000
    Epoch 2746/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 5.1611e-04 - acc: 1.0000
    Epoch 2747/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.8318e-04 - acc: 1.0000
    Epoch 2748/3000
    2559/2559 [==============================] - 28s 11ms/step - loss: 4.9686e-04 - acc: 1.0000
    Epoch 2749/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.4564e-04 - acc: 1.0000
    Epoch 2750/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 2751/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0017 - acc: 0.9996
    Epoch 2752/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.1988e-04 - acc: 1.0000
    Epoch 2753/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.3760e-04 - acc: 1.0000
    Epoch 2754/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 7.0732e-04 - acc: 1.0000
    Epoch 2755/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.8987e-04 - acc: 1.0000
    Epoch 2756/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 4.6723e-04 - acc: 1.0000
    Epoch 2757/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.1291e-04 - acc: 1.0000
    Epoch 2758/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.2653e-04 - acc: 1.0000
    Epoch 2759/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 7.7254e-04 - acc: 0.9996
    Epoch 2760/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 7.6136e-04 - acc: 0.9996
    Epoch 2761/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.1497e-04 - acc: 1.0000
    Epoch 2762/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.0753e-04 - acc: 1.0000
    Epoch 2763/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.9738e-04 - acc: 1.0000
    Epoch 2764/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.8681e-04 - acc: 1.0000
    Epoch 2765/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.0560e-04 - acc: 1.0000
    Epoch 2766/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.2054e-04 - acc: 1.0000
    Epoch 2767/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 4.4472e-04 - acc: 1.0000
    Epoch 2768/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.8130e-04 - acc: 1.0000
    Epoch 2769/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.7718e-04 - acc: 1.0000
    Epoch 2770/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.8245e-04 - acc: 1.0000
    Epoch 2771/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.3814e-04 - acc: 1.0000
    Epoch 2772/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.1660e-04 - acc: 1.0000
    Epoch 2773/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.7813e-04 - acc: 1.0000
    Epoch 2774/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0020 - acc: 0.9996
    Epoch 2775/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 6.3700e-04 - acc: 1.0000
    Epoch 2776/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 4.6372e-04 - acc: 1.0000
    Epoch 2777/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 8.9379e-04 - acc: 0.9996
    Epoch 2778/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 5.6218e-04 - acc: 1.0000
    Epoch 2779/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.9717e-04 - acc: 1.0000
    Epoch 2780/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 4.4394e-04 - acc: 1.0000
    Epoch 2781/3000
    2559/2559 [==============================] - 26s 10ms/step - loss: 4.6429e-04 - acc: 1.0000
    Epoch 2782/3000
    2559/2559 [==============================] - 40s 16ms/step - loss: 4.7334e-04 - acc: 1.0000
    Epoch 2783/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.3745e-04 - acc: 1.0000
    Epoch 2784/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.3953e-04 - acc: 1.0000
    Epoch 2785/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2786/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.1742e-04 - acc: 1.0000
    Epoch 2787/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 5.8650e-04 - acc: 1.0000
    Epoch 2788/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.0139e-04 - acc: 1.0000
    Epoch 2789/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 7.4322e-04 - acc: 1.0000
    Epoch 2790/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.1550e-04 - acc: 1.0000
    Epoch 2791/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.1230e-04 - acc: 1.0000
    Epoch 2792/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 5.0192e-04 - acc: 1.0000
    Epoch 2793/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 5.0251e-04 - acc: 1.0000
    Epoch 2794/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 8.6409e-04 - acc: 0.9996
    Epoch 2795/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.1402e-04 - acc: 1.0000
    Epoch 2796/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 7.2616e-04 - acc: 0.9996
    Epoch 2797/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 4.1836e-04 - acc: 1.0000
    Epoch 2798/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 6.1066e-04 - acc: 1.0000
    Epoch 2799/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.1779e-04 - acc: 1.0000
    Epoch 2800/3000
    2559/2559 [==============================] - 17s 6ms/step - loss: 4.6917e-04 - acc: 1.0000
    Epoch 2801/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.7533e-04 - acc: 1.0000
    Epoch 2802/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.4679e-04 - acc: 1.0000
    Epoch 2803/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.8527e-04 - acc: 1.0000
    Epoch 2804/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 5.9099e-04 - acc: 1.0000
    Epoch 2805/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 7.1581e-04 - acc: 1.0000
    Epoch 2806/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 4.5953e-04 - acc: 1.0000
    Epoch 2807/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.8864e-04 - acc: 1.0000
    Epoch 2808/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.4758e-04 - acc: 1.0000
    Epoch 2809/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 5.1982e-04 - acc: 1.0000
    Epoch 2810/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.5183e-04 - acc: 1.0000
    Epoch 2811/3000
    2559/2559 [==============================] - 29s 11ms/step - loss: 5.1351e-04 - acc: 1.0000
    Epoch 2812/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 0.9996
    Epoch 2813/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 8.7720e-04 - acc: 0.9996
    Epoch 2814/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.8248e-04 - acc: 1.0000
    Epoch 2815/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.5828e-04 - acc: 1.0000
    Epoch 2816/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.7637e-04 - acc: 1.0000
    Epoch 2817/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.3218e-04 - acc: 1.0000
    Epoch 2818/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.7534e-04 - acc: 1.0000
    Epoch 2819/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0010 - acc: 0.9996
    Epoch 2820/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.3963e-04 - acc: 1.0000
    Epoch 2821/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 8.3103e-04 - acc: 0.9996
    Epoch 2822/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0010 - acc: 0.9996
    Epoch 2823/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.4218e-04 - acc: 1.0000
    Epoch 2824/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.3464e-04 - acc: 1.0000
    Epoch 2825/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.3384e-04 - acc: 1.0000
    Epoch 2826/3000
    2559/2559 [==============================] - 16s 6ms/step - loss: 5.4827e-04 - acc: 1.0000
    Epoch 2827/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.4772e-04 - acc: 1.0000
    Epoch 2828/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 5.0841e-04 - acc: 1.0000
    Epoch 2829/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0010 - acc: 0.9996
    Epoch 2830/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.7441e-04 - acc: 1.0000
    Epoch 2831/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.2441e-04 - acc: 1.0000
    Epoch 2832/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.6035e-04 - acc: 1.0000
    Epoch 2833/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 9.7090e-04 - acc: 1.0000
    Epoch 2834/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.1181e-04 - acc: 1.0000
    Epoch 2835/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 4.8613e-04 - acc: 1.0000
    Epoch 2836/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.9035e-04 - acc: 0.9996
    Epoch 2837/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.5540e-04 - acc: 1.0000
    Epoch 2838/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2839/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.9753e-04 - acc: 1.0000
    Epoch 2840/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 5.1422e-04 - acc: 1.0000
    Epoch 2841/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.8661e-04 - acc: 1.0000
    Epoch 2842/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 7.0244e-04 - acc: 0.9996
    Epoch 2843/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.5871e-04 - acc: 1.0000
    Epoch 2844/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 5.1645e-04 - acc: 1.0000
    Epoch 2845/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 2846/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.4956e-04 - acc: 1.0000
    Epoch 2847/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0010 - acc: 0.9996
    Epoch 2848/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 7.1682e-04 - acc: 0.9996
    Epoch 2849/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 5.0071e-04 - acc: 1.0000
    Epoch 2850/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.3256e-04 - acc: 1.0000
    Epoch 2851/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.5163e-04 - acc: 1.0000
    Epoch 2852/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 5.1173e-04 - acc: 1.0000
    Epoch 2853/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0014 - acc: 0.9992
    Epoch 2854/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 4.3452e-04 - acc: 1.0000
    Epoch 2855/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 0.9996
    Epoch 2856/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 4.6473e-04 - acc: 1.0000
    Epoch 2857/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 3.6845e-04 - acc: 1.0000
    Epoch 2858/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 5.4026e-04 - acc: 1.0000
    Epoch 2859/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 3.4418e-04 - acc: 1.0000
    Epoch 2860/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.5293e-04 - acc: 1.0000
    Epoch 2861/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.8004e-04 - acc: 1.0000
    Epoch 2862/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.1145e-04 - acc: 1.0000
    Epoch 2863/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.2224e-04 - acc: 1.0000
    Epoch 2864/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 4.0908e-04 - acc: 1.0000
    Epoch 2865/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 2.9213e-04 - acc: 1.0000
    Epoch 2866/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.0794e-04 - acc: 1.0000
    Epoch 2867/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 9.7489e-04 - acc: 0.9996
    Epoch 2868/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 3.6080e-04 - acc: 1.0000
    Epoch 2869/3000
    2559/2559 [==============================] - 23s 9ms/step - loss: 5.2293e-04 - acc: 1.0000
    Epoch 2870/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.3262e-04 - acc: 1.0000
    Epoch 2871/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.2166e-04 - acc: 1.0000
    Epoch 2872/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 3.8570e-04 - acc: 1.0000
    Epoch 2873/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 2.8228e-04 - acc: 1.0000
    Epoch 2874/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 6.2047e-04 - acc: 1.0000
    Epoch 2875/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.3127e-04 - acc: 1.0000
    Epoch 2876/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 5.3255e-04 - acc: 1.0000
    Epoch 2877/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.6092e-04 - acc: 1.0000
    Epoch 2878/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.1273e-04 - acc: 1.0000
    Epoch 2879/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 5.4265e-04 - acc: 0.9996
    Epoch 2880/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.4100e-04 - acc: 1.0000
    Epoch 2881/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.1154e-04 - acc: 1.0000
    Epoch 2882/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 6.2658e-04 - acc: 1.0000
    Epoch 2883/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.8721e-04 - acc: 1.0000
    Epoch 2884/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 9.3784e-04 - acc: 0.9996
    Epoch 2885/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.0560e-04 - acc: 1.0000
    Epoch 2886/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.5960e-04 - acc: 1.0000
    Epoch 2887/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0015 - acc: 0.9992
    Epoch 2888/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.1464e-04 - acc: 1.0000
    Epoch 2889/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 6.3075e-04 - acc: 1.0000
    Epoch 2890/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 3.8897e-04 - acc: 1.0000
    Epoch 2891/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 2.7794e-04 - acc: 1.0000
    Epoch 2892/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 4.3284e-04 - acc: 1.0000
    Epoch 2893/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.6535e-04 - acc: 1.0000
    Epoch 2894/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.4061e-04 - acc: 1.0000
    Epoch 2895/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 4.3874e-04 - acc: 1.0000
    Epoch 2896/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.2203e-04 - acc: 1.0000
    Epoch 2897/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 9.0695e-04 - acc: 0.9996
    Epoch 2898/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 3.0103e-04 - acc: 1.0000
    Epoch 2899/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 3.8039e-04 - acc: 1.0000
    Epoch 2900/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 2.6919e-04 - acc: 1.0000
    Epoch 2901/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 7.9063e-04 - acc: 0.9996
    Epoch 2902/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 4.0155e-04 - acc: 1.0000
    Epoch 2903/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.9413e-04 - acc: 1.0000
    Epoch 2904/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 2.6531e-04 - acc: 1.0000
    Epoch 2905/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0010 - acc: 0.9992
    Epoch 2906/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 3.6940e-04 - acc: 1.0000
    Epoch 2907/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 3.9405e-04 - acc: 1.0000
    Epoch 2908/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 4.0137e-04 - acc: 1.0000
    Epoch 2909/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 7.0714e-04 - acc: 0.9996
    Epoch 2910/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 3.4088e-04 - acc: 1.0000
    Epoch 2911/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 2.8690e-04 - acc: 1.0000
    Epoch 2912/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 5.9613e-04 - acc: 0.9996
    Epoch 2913/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 5.3862e-04 - acc: 1.0000
    Epoch 2914/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 2.9215e-04 - acc: 1.0000
    Epoch 2915/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 2.7700e-04 - acc: 1.0000
    Epoch 2916/3000
    2559/2559 [==============================] - 25s 10ms/step - loss: 2.7963e-04 - acc: 1.0000
    Epoch 2917/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 2.6864e-04 - acc: 1.0000
    Epoch 2918/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 6.6140e-04 - acc: 0.9996
    Epoch 2919/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 4.6119e-04 - acc: 1.0000
    Epoch 2920/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0016 - acc: 0.9996
    Epoch 2921/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.7183e-04 - acc: 1.0000
    Epoch 2922/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 7.9216e-04 - acc: 1.0000
    Epoch 2923/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2924/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0011 - acc: 0.9996
    Epoch 2925/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0011 - acc: 1.0000
    Epoch 2926/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2927/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0014 - acc: 0.9996
    Epoch 2928/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 6.6505e-04 - acc: 1.0000
    Epoch 2929/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0033 - acc: 0.9992
    Epoch 2930/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0027 - acc: 0.9996
    Epoch 2931/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0201 - acc: 0.9945
    Epoch 2932/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0093 - acc: 0.9973
    Epoch 2933/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0198 - acc: 0.9945
    Epoch 2934/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0204 - acc: 0.9945
    Epoch 2935/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0169 - acc: 0.9937
    Epoch 2936/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0157 - acc: 0.9953
    Epoch 2937/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0086 - acc: 0.9984
    Epoch 2938/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0137 - acc: 0.9961
    Epoch 2939/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0317 - acc: 0.9898
    Epoch 2940/3000
    2559/2559 [==============================] - 24s 9ms/step - loss: 0.0218 - acc: 0.9941
    Epoch 2941/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0157 - acc: 0.9973
    Epoch 2942/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0407 - acc: 0.9879
    Epoch 2943/3000
    2559/2559 [==============================] - 33s 13ms/step - loss: 0.0676 - acc: 0.9816
    Epoch 2944/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.2977 - acc: 0.9359
    Epoch 2945/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1947 - acc: 0.9512
    Epoch 2946/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1772 - acc: 0.9555
    Epoch 2947/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.2458 - acc: 0.9340
    Epoch 2948/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.2124 - acc: 0.9437
    Epoch 2949/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.2183 - acc: 0.9367
    Epoch 2950/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1472 - acc: 0.9535
    Epoch 2951/3000
    2559/2559 [==============================] - 27s 11ms/step - loss: 0.1877 - acc: 0.9414
    Epoch 2952/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.1029 - acc: 0.9644
    Epoch 2953/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.1346 - acc: 0.9551
    Epoch 2954/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1020 - acc: 0.9672
    Epoch 2955/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0747 - acc: 0.9746
    Epoch 2956/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.1426 - acc: 0.9523
    Epoch 2957/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.1021 - acc: 0.9633
    Epoch 2958/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.1541 - acc: 0.9519
    Epoch 2959/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0595 - acc: 0.9805
    Epoch 2960/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0503 - acc: 0.9809
    Epoch 2961/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0967 - acc: 0.9687
    Epoch 2962/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0525 - acc: 0.9785
    Epoch 2963/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0744 - acc: 0.9738
    Epoch 2964/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0284 - acc: 0.9926
    Epoch 2965/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0308 - acc: 0.9902
    Epoch 2966/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0157 - acc: 0.9977
    Epoch 2967/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0165 - acc: 0.9941
    Epoch 2968/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0154 - acc: 0.9965
    Epoch 2969/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0144 - acc: 0.9961
    Epoch 2970/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0126 - acc: 0.9969
    Epoch 2971/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0088 - acc: 0.9988
    Epoch 2972/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0089 - acc: 0.9984
    Epoch 2973/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0070 - acc: 0.9996
    Epoch 2974/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0065 - acc: 0.9992
    Epoch 2975/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0047 - acc: 1.0000
    Epoch 2976/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0041 - acc: 1.0000
    Epoch 2977/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0044 - acc: 1.0000
    Epoch 2978/3000
    2559/2559 [==============================] - 20s 8ms/step - loss: 0.0041 - acc: 0.9996
    Epoch 2979/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0041 - acc: 1.0000
    Epoch 2980/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0035 - acc: 0.9996
    Epoch 2981/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0032 - acc: 1.0000
    Epoch 2982/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0039 - acc: 0.9996
    Epoch 2983/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0048 - acc: 0.9992
    Epoch 2984/3000
    2559/2559 [==============================] - 21s 8ms/step - loss: 0.0035 - acc: 0.9996
    Epoch 2985/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0027 - acc: 1.0000
    Epoch 2986/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0030 - acc: 0.9996
    Epoch 2987/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0028 - acc: 0.9996
    Epoch 2988/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0026 - acc: 1.0000
    Epoch 2989/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0025 - acc: 1.0000
    Epoch 2990/3000
    2559/2559 [==============================] - 19s 8ms/step - loss: 0.0020 - acc: 1.0000
    Epoch 2991/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0030 - acc: 0.9996
    Epoch 2992/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0023 - acc: 0.9996
    Epoch 2993/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0021 - acc: 0.9996
    Epoch 2994/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0024 - acc: 0.9996
    Epoch 2995/3000
    2559/2559 [==============================] - 17s 7ms/step - loss: 0.0030 - acc: 0.9992
    Epoch 2996/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0033 - acc: 0.9992
    Epoch 2997/3000
    2559/2559 [==============================] - 22s 9ms/step - loss: 0.0037 - acc: 0.9988
    Epoch 2998/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0029 - acc: 0.9992
    Epoch 2999/3000
    2559/2559 [==============================] - 18s 7ms/step - loss: 0.0018 - acc: 1.0000
    Epoch 3000/3000
    2559/2559 [==============================] - 19s 7ms/step - loss: 0.0018 - acc: 1.0000
    
    190b39cd44764521914cc65eb1016880T not found.
    

    数据过滤(filter)使用错误,你可以:

    1.一键查看文档

    2.一键搜索答案

    Traceback (most recent call last):
      File "module2/modules/filter/v3/__init__.py", line 47, in biglearning.module2.modules.filter.v3.__init__.BigQuantModule.run
      File "impl/dsimpl/hdf.py", line 77, in iter_df
      File "/usr/local/python3/lib/python3.5/site-packages/pandas/io/pytables.py", line 467, in __init__
        self.open(mode=mode, **kwargs)
      File "/usr/local/python3/lib/python3.5/site-packages/pandas/io/pytables.py", line 580, in open
        self._handle = tables.open_file(self._path, self._mode, **kwargs)
      File "/usr/local/python3/lib/python3.5/site-packages/tables/file.py", line 320, in open_file
        return File(filename, mode, title, root_uep, filters, **kwargs)
      File "/usr/local/python3/lib/python3.5/site-packages/tables/file.py", line 784, in __init__
        self._g_new(filename, mode, **params)
      File "tables/hdf5extension.pyx", line 369, in tables.hdf5extension.File._g_new (tables/hdf5extension.c:4577)
      File "/usr/local/python3/lib/python3.5/site-packages/tables/utils.py", line 156, in check_file_access
        raise IOError("``%s`` does not exist" % (filename,))
    OSError: ``/var/app/data/bigquant/datasource/user/v3/1/90/190b39cd44764521914cc65eb1016880T`` does not exist
    
    During handling of the above exception, another exception occurred:
    
    Traceback (most recent call last):
      File "module2/common/moduleinvoker.py", line 208, in biglearning.module2.common.moduleinvoker._invoke_with_cache
      File "module2/common/moduleinvoker.py", line 167, in biglearning.module2.common.moduleinvoker._module_run
      File "module2/modules/filter/v3/__init__.py", line 69, in biglearning.module2.modules.filter.v3.__init__.BigQuantModule.run
      File "common/dataframe.py", line 51, in bigshared.common.dataframe.evalex
    AttributeError: 'NoneType' object has no attribute 'columns'
    
    During handling of the above exception, another exception occurred:
    
    Traceback (most recent call last):
      File "/usr/local/python3/lib/python3.5/site-packages/logbook/handlers.py", line 213, in handle
        self.emit(record)
      File "/usr/local/python3/lib/python3.5/site-packages/logbook/handlers.py", line 839, in emit
        self.perform_rollover()
      File "/usr/local/python3/lib/python3.5/site-packages/logbook/handlers.py", line 828, in perform_rollover
        self.stream.close()
    AttributeError: 'NoneType' object has no attribute 'close'
    Logged from file <ipython-input-2-26454f46c776>, line 329
    
    ---------------------------------------------------------------------------
    OSError                                   Traceback (most recent call last)
    OSError: ``/var/app/data/bigquant/datasource/user/v3/1/90/190b39cd44764521914cc65eb1016880T`` does not exist
    
    During handling of the above exception, another exception occurred:
    
    AttributeError                            Traceback (most recent call last)
    <ipython-input-2-26454f46c776> in <module>()
        327     input_data=m18.data,
        328     expr='date>\'2017-06-01\'',
    --> 329     output_left_data=False
        330 )
        331 
    
    AttributeError: 'NoneType' object has no attribute 'columns'