{ "cells": [ { "cell_type": "markdown", "id": "e52888cd", "metadata": {}, "source": [ "### Recommendation System on Amazon SageMaker - Beginner (Factorization Machine)" ] }, { "cell_type": "markdown", "id": "d702a38f", "metadata": {}, "source": [ "이 노트북에서는 Amazon Sagemaker를 사용하여 Factorization machine 으로 간단한 영화 추천 모델을 구축합니다.\n", "\n", "SageMaker built-in 알고리즘으로서의 Factorization machine 에 대한 자세한 정보는 [여기](https://docs.aws.amazon.com/sagemaker/latest/dg/fact-machines.html) 에서 확인하실 수 있습니다." ] }, { "cell_type": "markdown", "id": "3231ae4d", "metadata": {}, "source": [ "### Factorization Machine\n", "\n", "Factorization Machine (FM) 은 2010년에 도입된 지도 학습 기술입니다 ([연구 논문](https://www.csie.ntu.edu.tw/~b97053/paper/Rendle2010FM.pdf)). FM은 행렬 인수 분해를 통해 문제 차원을 줄이는 능력에서 이름을 얻었습니다.\n", "\n", "FM 은 분류 또는 회귀에 사용할 수 있으며 대규모 희소 데이터 세트에서 선형 회귀와 같은 기존 알고리즘보다 훨씬 계산 효율적입니다. 바로 이 속성이 FM 이 추천을 위해 널리 사용되는 이유입니다. 실제 추천 수는 매우 적지 만 사용자 수와 항목 수는 일반적으로 매우 큽니다 (사용자가 사용 가능한 모든 아이템을 평가하지는 않음).\n", "\n", "다음은 FM 이 데이터셋에서 어떻게 피쳐 벡터가 생성되는지를 보여주는 간단한 예입니다. 한 행(row) 에는 하나의 user 와 movie 에 대한 정보가 들어가 있는것을 확인할 수 있습니다. 각 영화 섹션에 대한 평점은 (주황색, 노랑색, 빨간색) 각 열의 합이 1이 되도록 Normalize 되어 있습니다. 마지막 Last movie rated 섹션은 주황색 섹션의 평점 바로 이전에 평점을 준 아이템이 무엇인지 알려줍니다.\n", "\n", "\n", "\n", "
\n", "\n", "
" ] }, { "cell_type": "markdown", "id": "28f70445", "metadata": {}, "source": [ "### Preparation" ] }, { "cell_type": "code", "execution_count": 45, "id": "92c96130", "metadata": {}, "outputs": [], "source": [ "import sagemaker\n", "import sagemaker.amazon.common as smac\n", "from sagemaker import get_execution_role\n", "from sagemaker.predictor import json_deserializer\n", "\n", "import boto3, csv, io, json\n", "import numpy as np\n", "from scipy.sparse import lil_matrix" ] }, { "cell_type": "code", "execution_count": 2, "id": "8e3dbb66", "metadata": {}, "outputs": [], "source": [ "sess = sagemaker.Session()\n", "bucket = sess.default_bucket() \n", "prefix = 'sagemaker/movielens'\n", "region = boto3.Session().region_name" ] }, { "cell_type": "code", "execution_count": 3, "id": "9e60d881", "metadata": {}, "outputs": [], "source": [ "role = sagemaker.get_execution_role()" ] }, { "cell_type": "code", "execution_count": 4, "id": "6d308f16", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Sagemaker session : \n", "S3 bucket : sagemaker-ap-northeast-2-806174985048\n", "Prefix : sagemaker/movielens\n", "Region selected : ap-northeast-2\n", "IAM role : arn:aws:iam::806174985048:role/service-role/AmazonSageMaker-ExecutionRole-20201218T151409\n" ] } ], "source": [ "print('Sagemaker session :', sess)\n", "print('S3 bucket :', bucket)\n", "print('Prefix :', prefix)\n", "print('Region selected :', region)\n", "print('IAM role :', role)" ] }, { "cell_type": "markdown", "id": "ac605419", "metadata": {}, "source": [ "### Build training set and test set" ] }, { "cell_type": "code", "execution_count": 5, "id": "1531054e", "metadata": {}, "outputs": [], "source": [ "nbUsers=943\n", "nbMovies=1682\n", "nbFeatures=nbUsers+nbMovies\n", "\n", "nbRatingsTrain=90570\n", "nbRatingsTest=9430" ] }, { "cell_type": "markdown", "id": "a1fd2f5e", "metadata": {}, "source": [ "### Dataset - MovieLens\n", "\n", "이 데이터 셋은 추천 시스템에 사용되기 좋은 데이터 셋입니다. 다양한 크기로 제공되는데 이 예제에서는 ml100k: 1682편의 영화에서 943명의 사용자가 제공하는 100,000개의 평점을 사용할 것입니다. 보시다시피 ml100k 등급 행렬은 가능한 1,586,126 (943 by 1682) 중 100,000개의 등급만 보유하기 때문에 매우 스파스되어 있습니다. (정확하게는 93.6%).\n", "\n", "다음은 데이터 세트의 처음 10개 줄입니다. 예를 들면, 사용자 754가 영화 595에 2성급 등급을 부여했습니다." ] }, { "cell_type": "markdown", "id": "458184e8", "metadata": {}, "source": [ "\n", "| user id | movie id | rating | timestamp |\n", "| :--- | :--- | :--- | :--- |\n", "| 754 | 595 | 2 | 879452073 |\n", "| 932 | 157 | 4 | 891250667 |\n", "|751| 100| 4| 889132252|\n", "|101| 820| 3| 877136954|\n", "|606| 1277| 3| 878148493|\n", "|581| 475 | 4| 879641850|\n", "|13| 50| 5| 882140001|\n", "|457| 59| 5| 882397575|\n", "|111| 321| 3| 891680076|\n", "|123| 657| 4| 879872066|\n" ] }, { "cell_type": "code", "execution_count": 6, "id": "96c38da7", "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ " % Total % Received % Xferd Average Speed Time Time Time Current\n", " Dload Upload Total Spent Left Speed\n", "100 4808k 100 4808k 0 0 2773k 0 0:00:01 0:00:01 --:--:-- 2771k\n" ] } ], "source": [ "%%bash\n", "\n", "curl -o data/ml-100k.zip http://files.grouplens.org/datasets/movielens/ml-100k.zip" ] }, { "cell_type": "code", "execution_count": 7, "id": "f3ff8669", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Archive: ml-100k.zip\n", " inflating: ml-100k/allbut.pl \n", " inflating: ml-100k/mku.sh \n", " inflating: ml-100k/README \n", " inflating: ml-100k/u.data \n", " inflating: ml-100k/u.genre \n", " inflating: ml-100k/u.info \n", " inflating: ml-100k/u.item \n", " inflating: ml-100k/u.occupation \n", " inflating: ml-100k/u.user \n", " inflating: ml-100k/u1.base \n", " inflating: ml-100k/u1.test \n", " inflating: ml-100k/u2.base \n", " inflating: ml-100k/u2.test \n", " inflating: ml-100k/u3.base \n", " inflating: ml-100k/u3.test \n", " inflating: ml-100k/u4.base \n", " inflating: ml-100k/u4.test \n", " inflating: ml-100k/u5.base \n", " inflating: ml-100k/u5.test \n", " inflating: ml-100k/ua.base \n", " inflating: ml-100k/ua.test \n", " inflating: ml-100k/ub.base \n", " inflating: ml-100k/ub.test \n" ] } ], "source": [ "!cd data && unzip -o ml-100k.zip" ] }, { "cell_type": "code", "execution_count": 9, "id": "adbcedf8", "metadata": {}, "outputs": [], "source": [ "!rm data/ml-100k.zip" ] }, { "cell_type": "markdown", "id": "fbb5ad98", "metadata": {}, "source": [ "#### Explore data using pandas" ] }, { "cell_type": "code", "execution_count": 55, "id": "96ab97ad", "metadata": {}, "outputs": [], "source": [ "import pandas as pd" ] }, { "cell_type": "code", "execution_count": 60, "id": "0409c6c8", "metadata": {}, "outputs": [], "source": [ "raw_df = pd.read_csv('./data/ml-100k/ua.base', delimiter='\\t', names=[\"user-id\", \"movie-id\", \"rating\", \"timestamp\"])" ] }, { "cell_type": "code", "execution_count": 61, "id": "5b250f10", "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
user-idmovie-idratingtimestamp
0115874965758
1123876893171
2134878542960
3143876893119
4153889751712
...............
9056594310472875502146
9056694310744888640250
9056794311883888640250
9056894312283888640275
9056994313303888692465
\n", "

90570 rows × 4 columns

\n", "
" ], "text/plain": [ " user-id movie-id rating timestamp\n", "0 1 1 5 874965758\n", "1 1 2 3 876893171\n", "2 1 3 4 878542960\n", "3 1 4 3 876893119\n", "4 1 5 3 889751712\n", "... ... ... ... ...\n", "90565 943 1047 2 875502146\n", "90566 943 1074 4 888640250\n", "90567 943 1188 3 888640250\n", "90568 943 1228 3 888640275\n", "90569 943 1330 3 888692465\n", "\n", "[90570 rows x 4 columns]" ] }, "execution_count": 61, "metadata": {}, "output_type": "execute_result" } ], "source": [ "raw_df" ] }, { "cell_type": "code", "execution_count": 62, "id": "1f902fd4", "metadata": {}, "outputs": [], "source": [ "# pass in column names for each CSV\n", "u_cols = ['user_id', 'age', 'sex', 'occupation', 'zip_code']\n", "users = pd.read_csv('./data/ml-100k/u.user', sep='|', names=u_cols,\n", " encoding='latin-1')\n", "\n", "r_cols = ['user_id', 'movie_id', 'rating', 'unix_timestamp']\n", "ratings = pd.read_csv('./data/ml-100k/u.data', sep='\\t', names=r_cols,\n", " encoding='latin-1')\n", "\n", "# the movies file contains columns indicating the movie's genres\n", "# let's only load the first five columns of the file with usecols\n", "m_cols = ['movie_id', 'title', 'release_date', 'video_release_date', 'imdb_url']\n", "movies = pd.read_csv('./data/ml-100k/u.item', sep='|', names=m_cols, usecols=range(5),\n", " encoding='latin-1')\n", "\n", "# create one merged DataFrame\n", "movie_ratings = pd.merge(movies, ratings)\n", "lens = pd.merge(movie_ratings, users)" ] }, { "cell_type": "code", "execution_count": 64, "id": "cb41e8e0", "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
movie_idtitlerelease_datevideo_release_dateimdb_urluser_idratingunix_timestampagesexoccupationzip_code
01Toy Story (1995)01-Jan-1995NaNhttp://us.imdb.com/M/title-exact?Toy%20Story%2...308488773653260Mretired95076
14Get Shorty (1995)01-Jan-1995NaNhttp://us.imdb.com/M/title-exact?Get%20Shorty%...308588773789060Mretired95076
25Copycat (1995)01-Jan-1995NaNhttp://us.imdb.com/M/title-exact?Copycat%20(1995)308488773960860Mretired95076
37Twelve Monkeys (1995)01-Jan-1995NaNhttp://us.imdb.com/M/title-exact?Twelve%20Monk...308488773884760Mretired95076
48Babe (1995)01-Jan-1995NaNhttp://us.imdb.com/M/title-exact?Babe%20(1995)308588773669660Mretired95076
\n", "
" ], "text/plain": [ " movie_id title release_date video_release_date \\\n", "0 1 Toy Story (1995) 01-Jan-1995 NaN \n", "1 4 Get Shorty (1995) 01-Jan-1995 NaN \n", "2 5 Copycat (1995) 01-Jan-1995 NaN \n", "3 7 Twelve Monkeys (1995) 01-Jan-1995 NaN \n", "4 8 Babe (1995) 01-Jan-1995 NaN \n", "\n", " imdb_url user_id rating \\\n", "0 http://us.imdb.com/M/title-exact?Toy%20Story%2... 308 4 \n", "1 http://us.imdb.com/M/title-exact?Get%20Shorty%... 308 5 \n", "2 http://us.imdb.com/M/title-exact?Copycat%20(1995) 308 4 \n", "3 http://us.imdb.com/M/title-exact?Twelve%20Monk... 308 4 \n", "4 http://us.imdb.com/M/title-exact?Babe%20(1995) 308 5 \n", "\n", " unix_timestamp age sex occupation zip_code \n", "0 887736532 60 M retired 95076 \n", "1 887737890 60 M retired 95076 \n", "2 887739608 60 M retired 95076 \n", "3 887738847 60 M retired 95076 \n", "4 887736696 60 M retired 95076 " ] }, "execution_count": 64, "metadata": {}, "output_type": "execute_result" } ], "source": [ "lens.head(5)" ] }, { "cell_type": "code", "execution_count": 72, "id": "37665143", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "title\n", "Star Wars (1977) 583\n", "Contact (1997) 509\n", "Fargo (1996) 508\n", "Return of the Jedi (1983) 507\n", "Liar Liar (1997) 485\n", "English Patient, The (1996) 481\n", "Scream (1996) 478\n", "Toy Story (1995) 452\n", "Air Force One (1997) 431\n", "Independence Day (ID4) (1996) 429\n", "Raiders of the Lost Ark (1981) 420\n", "Godfather, The (1972) 413\n", "Pulp Fiction (1994) 394\n", "Twelve Monkeys (1995) 392\n", "Silence of the Lambs, The (1991) 390\n", "Jerry Maguire (1996) 384\n", "Chasing Amy (1997) 379\n", "Rock, The (1996) 378\n", "Empire Strikes Back, The (1980) 367\n", "Star Trek: First Contact (1996) 365\n", "Back to the Future (1985) 350\n", "Titanic (1997) 350\n", "Mission: Impossible (1996) 344\n", "Fugitive, The (1993) 336\n", "Indiana Jones and the Last Crusade (1989) 331\n", "dtype: int64" ] }, "execution_count": 72, "metadata": {}, "output_type": "execute_result" } ], "source": [ "most_rated = lens.groupby('title').size().sort_values(ascending=False)[:25]\n", "most_rated" ] }, { "cell_type": "code", "execution_count": 73, "id": "cade319a", "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
rating
sizemean
title
'Til There Was You (1997)92.333333
1-900 (1994)52.600000
101 Dalmatians (1996)1092.908257
12 Angry Men (1957)1254.344000
187 (1997)413.024390
\n", "
" ], "text/plain": [ " rating \n", " size mean\n", "title \n", "'Til There Was You (1997) 9 2.333333\n", "1-900 (1994) 5 2.600000\n", "101 Dalmatians (1996) 109 2.908257\n", "12 Angry Men (1957) 125 4.344000\n", "187 (1997) 41 3.024390" ] }, "execution_count": 73, "metadata": {}, "output_type": "execute_result" } ], "source": [ "movie_stats = lens.groupby('title').agg({'rating': [np.size, np.mean]})\n", "movie_stats.head()" ] }, { "cell_type": "code", "execution_count": 67, "id": "35293d8c", "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
rating
sizemean
title
They Made Me a Criminal (1939)15.0
Marlene Dietrich: Shadow and Light (1996)15.0
Saint of Fort Washington, The (1993)25.0
Someone Else's America (1995)15.0
Star Kid (1997)35.0
\n", "
" ], "text/plain": [ " rating \n", " size mean\n", "title \n", "They Made Me a Criminal (1939) 1 5.0\n", "Marlene Dietrich: Shadow and Light (1996) 1 5.0\n", "Saint of Fort Washington, The (1993) 2 5.0\n", "Someone Else's America (1995) 1 5.0\n", "Star Kid (1997) 3 5.0" ] }, "execution_count": 67, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# sort by rating average\n", "movie_stats.sort_values([('rating', 'mean')], ascending=False).head()" ] }, { "cell_type": "code", "execution_count": 71, "id": "d70304cd", "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
rating
sizemean
title
Star Wars (1977)5834.358491
Silence of the Lambs, The (1991)3904.289744
Godfather, The (1972)4134.283293
Raiders of the Lost Ark (1981)4204.252381
Titanic (1997)3504.245714
Empire Strikes Back, The (1980)3674.204360
Princess Bride, The (1987)3244.172840
Fargo (1996)5084.155512
Monty Python and the Holy Grail (1974)3164.066456
Pulp Fiction (1994)3944.060914
Fugitive, The (1993)3364.044643
Return of the Jedi (1983)5074.007890
Terminator, The (1984)3013.933555
Indiana Jones and the Last Crusade (1989)3313.930514
Full Monty, The (1997)3153.926984
\n", "
" ], "text/plain": [ " rating \n", " size mean\n", "title \n", "Star Wars (1977) 583 4.358491\n", "Silence of the Lambs, The (1991) 390 4.289744\n", "Godfather, The (1972) 413 4.283293\n", "Raiders of the Lost Ark (1981) 420 4.252381\n", "Titanic (1997) 350 4.245714\n", "Empire Strikes Back, The (1980) 367 4.204360\n", "Princess Bride, The (1987) 324 4.172840\n", "Fargo (1996) 508 4.155512\n", "Monty Python and the Holy Grail (1974) 316 4.066456\n", "Pulp Fiction (1994) 394 4.060914\n", "Fugitive, The (1993) 336 4.044643\n", "Return of the Jedi (1983) 507 4.007890\n", "Terminator, The (1984) 301 3.933555\n", "Indiana Jones and the Last Crusade (1989) 331 3.930514\n", "Full Monty, The (1997) 315 3.926984" ] }, "execution_count": 71, "metadata": {}, "output_type": "execute_result" } ], "source": [ "atleast_100 = movie_stats['rating']['size'] >= 300\n", "movie_stats[atleast_100].sort_values([('rating', 'mean')], ascending=False)[:15]" ] }, { "cell_type": "code", "execution_count": 77, "id": "f9755812", "metadata": {}, "outputs": [ { "data": { "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEWCAYAAACJ0YulAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8QVMy6AAAACXBIWXMAAAsTAAALEwEAmpwYAAAZO0lEQVR4nO3de7QlZX3m8e9DNxe5CQwNcm9RQiQuRaZFlESN4MQoiqOiZsTVGhzGGRVJvIGaER2JOEaXqFFDvDUqKCIK0RkjoqhEB20Q5CZCsLnZdjcqF1GRxt/8UdXF5nhO9z6XfTnd389ae+1dVbuqnrP79Pnt962qt1JVSJIEsNmoA0iSxodFQZLUsShIkjoWBUlSx6IgSepYFCRJHYuC5kSSDyf5uzna1t5JfpVkQTt9YZKXzcW22+393yRL52p709jv25PcluRnw9631K94nYI2JMkKYFdgLXAfcDVwOnBaVf1+Btt6WVV9bRrrXAh8qqo+Mp19teueBDy8qo6e7rpzKclewI+Bfapq9SizTKX9rKiqk0abRKNkS0H9emZVbQfsA5wCvAH46FzvJMnCud7mmNgH+PkoC8JG/NlqDlkUNC1VdUdVnQe8AFia5JEAST6R5O3t652TfCnJ7Ul+keTbSTZL8klgb+Bf2u6h1ydZnKSSHJPkJuDrPfN6/4g9LMn3ktyR5NwkO7X7enKSW3ozJlmR5PAkTwPeCLyg3d/l7fKuO6rN9eYkNyZZneT0JA9ul63LsTTJTW3Xz5um+mySPLhdf027vTe32z8cOB/Yvc3xiUnWfUmSiybMqyQPb18/PcnVSe5KcmuS1/a874gkl7Wf93eSPGrCZ/GGJD8E7k6ysJ2+td3WtUkOW9+/ebudhyX5epKft5/Dp5Ps0LP8oCQ/aLf5uSSfXff70EfGaefRAFWVDx/rfQArgMMnmX8T8N/b158A3t6+fgfwYWDz9vFn3N9V+YBtAYuBoumO2gZ4UM+8he17LgRuBR7ZvufzNN1JAE8GbpkqL3DSuvf2LL+QpgsL4K+B64F9gW2Bc4BPTsj2z22uRwP3AI+Y4nM6HTgX2K5d98fAMVPlnLDuS4CLJswrmq4vgJXAn7WvdwQOal8fBKwGHgcsAJa2P/+WPZ/FZcBe7c+wP3AzsHvPz/iwPn4HHg48FdgSWAR8C3hvu2wL4Ebg1e2/93OA3/X8PkyZcaZ5fAzuYUtBs/FTYKdJ5t8L7EbTf35vVX272v/x63FSVd1dVb+ZYvknq+rKqrob+Dvg+esORM/Si4D3VNUNVfUr4ETghRNaKW+tqt9U1eXA5TTF4QHaLC8ATqyqu6pqBfBu4MVzkBGaz/SAJNtX1S+r6tJ2/n8F/qmqLq6q+6pqGU3hOqRn3fdV1c3tZ3sfzR/jA5JsXlUrqurfN7Tzqrq+qs6vqnuqag3wHuBJ7eJDgIXtfu6tqnOA7/Wsvr6MM8qjwbEoaDb2AH4xyfx30Xz7/mqSG5Kc0Me2bp7G8htpvpHu3FfK9du93V7vthfSHFhfp/dsoV/TtCgm2pn7vzH3bmuPOcgI8Fzg6cCNSb6Z5PHt/H2A17TdMrcnuZ2mVbB7z7rdZ1dV1wPH07SgVif5TJLe904qyS7te29NcifwKe7//HcHbp1Q+Hv/vabMONM8GhyLgmYkyWNp/uBdNHFZ+035NVW1L/BM4G97+omnajFsqCWxV8/rvWm+Od8G3A1s3ZNrAU33Rr/b/SnNH63eba8FVm1gvYluazNN3Natfa4/8ed4SO/Cqvp+VR0J7AJ8ETirXXQzcHJV7dDz2LqqzuxdfcK2zqiqP22zFvDOPvK9o33vo6pqe+BoIO2ylcAeSdLz/t5/r/VmnGEeDYhFQdOSZPskRwCfoemrv2KS9xyR5OHtH4k7aboI7msXr6Lpv5+uo5MckGRr4G3A2VV1H02//VZJnpFkc+DNNN0R66wCFieZ6nf9TOBvkjw0ybbA3wOfraq10wnXZjkLODnJdkn2Af6W5ht1Py4H/iTJgUm2ovnmDECSLZK8KMmDq+pe7v9MoTne8fIkj0tjm/az2G6ynSTZP8lTkmwJ/Bb4Tc+21mc74FfA7Un2AF7Xs+y77TZe2R7IPhI4uGf5lBlnkUcDYlFQv/4lyV003/reRNOn/NIp3rsf8DWaPyLfBT5YVRe2y94BvLntRnjtFOtP5pM0B7N/BmwFHAfN2VDA/wA+QvOt/G6g92ykz7XPP09yKX/oY+22vwX8hOYP06umkavXq9r930DTgjqj3f4GVdWPaYrd14Dr+MMW2IuBFW3XzctpvqlTVctp+uw/APySptvuJevZ1ZY0pxTfRvNZ7kJzhtaGvJXmgPEdwJdpDsivy/47moPLxwC3t9m+RHPcYEMZZ5pHA+LFa5LmXJKLgQ9X1cdHnUXTY0tB0qwleVKSh7TdR0uBRwFfGXUuTZ9XOEqaC/vTHFPZFvh34HlVtXK0kTQTdh9JkjoD6z5K8rE0wwZc2TNvpyTnJ7mufd6xZ9mJSa5vL3P/i0HlkiRNbWAthSRPpDn75PSqWjc+zv8GflFVp7QXNO1YVW9IcgDNqYEH01wI8zXgj9rT/Ka088471+LFiweSX5I2VpdccsltVbVosmUDO6ZQVd9KsnjC7CNpxoABWEYzBs0b2vmfqap7gJ8kuZ6mQHx3fftYvHgxy5cvn8PUkrTxS3LjVMuGffbRrusOPrXPu7Tz9+CBl8XfwhTDAyQ5NsnyJMvXrFkz0LCStKkZl1NSM8m8Sfu1quq0qlpSVUsWLZq09SNJmqFhF4VVSXYDaJ/X3XDkFh44VsqeNGPSSJKGaNhF4TyasdRpn8/tmf/CJFsmeSjNMAnfm2R9SdIADexAc5IzaQ4q75zmzlhvoRnj5Kwkx9DcoOUogKq6KslZNPf+XQu8YkNnHkmS5t4gzz76qykWTXqrvao6GTh5UHkkSRs2LgeaJUljwKIgSepYFCRJHUdJ1VhZfMKX+3rfilOeMeAk0qbJloIkqWNRkCR1LAqSpI5FQZLUsShIkjoWBUlSx6IgSepYFCRJHYuCJKljUZAkdSwKkqSORUGS1LEoSJI6FgVJUseiIEnqWBQkSR2LgiSpY1GQJHUsCpKkjkVBktSxKEiSOhYFSVLHoiBJ6lgUJEkdi4IkqWNRkCR1LAqSpI5FQZLUsShIkjoWBUlSZyRFIcnfJLkqyZVJzkyyVZKdkpyf5Lr2ecdRZJOkTdnQi0KSPYDjgCVV9UhgAfBC4ATggqraD7ignZYkDdGouo8WAg9KshDYGvgpcCSwrF2+DHj2aKJJ0qZr6EWhqm4F/gG4CVgJ3FFVXwV2raqV7XtWArtMtn6SY5MsT7J8zZo1w4otSZuEUXQf7UjTKngosDuwTZKj+12/qk6rqiVVtWTRokWDiilJm6RRdB8dDvykqtZU1b3AOcATgFVJdgNon1ePIJskbdJGURRuAg5JsnWSAIcB1wDnAUvb9ywFzh1BNknapC0c9g6r6uIkZwOXAmuBHwCnAdsCZyU5hqZwHDXsbJK0qRt6UQCoqrcAb5kw+x6aVoMkaUS8olmS1LEoSJI6FgVJUseiIEnqWBQkSR2LgiSpY1GQJHUsCpKkjkVBktQZyRXNmluLT/hyX+9bccozBpxE0nxnS0GS1LGloFmxlSJtXGwpSJI6FgVJUsfuIw1Fv91MkkbLloIkqWNRkCR1LAqSpI5FQZLUsShIkjoWBUlSx6IgSepYFCRJHYuCJKmzwaKQ5NAk27Svj07yniT7DD6aJGnY+mkpfAj4dZJHA68HbgROH2gqSdJI9FMU1lZVAUcCp1bVqcB2g40lSRqFfgbEuyvJicDRwBOTLAA2H2wsSdIo9NNSeAFwD3BMVf0M2AN410BTSZJGYr0thbZV8KmqOnzdvKq6CY8pzEvTGb7aO6VJm6b1thSq6j6ag8wPHlIeSdII9XNM4bfAFUnOB+5eN7OqjhtYKknSSPRTFL7cPiRJG7kNFoWqWpbkQcDeVXXtEDJJkkaknyuanwlcBnylnT4wyXmz2WmSHZKcneRHSa5J8vgkOyU5P8l17fOOs9mHJGn6+uk+Ogk4GLgQoKouS/LQWe73VOArVfW8JFsAWwNvBC6oqlOSnACcALxhlvvRDE3nTCVJG49+r2i+Y8K8mukOk2wPPBH4KEBV/a6qbqe5YnpZ+7ZlwLNnug9J0sz0UxSuTPJfgAVJ9kvyfuA7s9jnvsAa4ONJfpDkI+2Ae7tW1UqA9nmXyVZOcmyS5UmWr1mzZhYxJEkT9VMUXgX8Cc1VzWcCdwLHz2KfC4GDgA9V1WNoTnM9od+Vq+q0qlpSVUsWLVo0ixiSpIk2WBSq6tdV9aaqeizwOOCdVfXbWezzFuCWqrq4nT6bpkisSrIbQPu8ehb7kCTNQD9nH52RZPu2i+cq4Nokr5vpDtvxk25Osn876zDgauA8YGk7bylw7kz3IUmamX7OPjqgqu5M8iLg/9CcEXQJsxsU71XAp9szj24AXkpToM5KcgxwE3DULLYvSZqBforC5kk2pzkb6ANVdW+SGZ99BM1prcCSSRYdNpvtSpJmp58Dzf8ErAC2Ab7V3orzzkGGkiSNRj/DXLwPeF/PrBuT/PngIkmSRmWDRSHJ/5xi0dvmOIskacT6OaZwd8/rrYAjgGsGE0eSNEr9dB+9u3c6yT/QnD4qSdrI9HOgeaKtaYaqkCRtZPo5pnAF9w+AtwBYhMcTJGmj1M8xhSN6Xq8FVlXV2gHlkfrS79DeK055xoCTSBuXfo4p3DiMIJKk0ZvJMQVJ0kZqyqKQZMthBpEkjd76WgrfBUjyySFlkSSN2PqOKWyRZCnwhCTPmbiwqs4ZXCxp/vNguOaj9RWFlwMvAnYAnjlhWQEWBUnayExZFKrqIuCiJMur6qNDzCRJGpF+rlP4ZJLjgCe2098EPlxV9w4uliRpFPopCh8ENm+fAV4MfAh42aBCSZJGo5+i8NiqenTP9NeTXD6oQJKk0enn4rX7kjxs3USSfYH7BhdJkjQq/bQUXgd8I8kNQIB9gJcONJUkaST6GfvogiT7AfvTFIUfVdU9A08mSRq6floKtEXghwPOIkkaMQfEkyR1LAqSpM4Gi0KSC/qZJ0ma/6Y8ppBkK5r7Me+cZEeag8wA2wO7DyGbJGnI1neg+b8Bx9MUgEu4vyjcCfzjYGNJkkZhfQPinQqcmuRVVfX+IWaSJI1IP9cpvD/JE4DFve+vqtMHmEuSNAIbLArtndceBlzG/cNbFGBR0NjzRjfS9PRz8doS4ICqqkGHkSSNVj/XKVwJPGTQQSRJo9dPS2Fn4Ook3wO6MY+q6lkDSyVJGol+isJJgw4hSRoP/Zx99M1B7DjJAmA5cGtVHZFkJ+CzNGc5rQCeX1W/HMS+JUmT62eYi7uS3Nk+fpvkviR3zsG+Xw1c0zN9AnBBVe0HXNBOS5KGaINFoaq2q6rt28dWwHOBD8xmp0n2BJ4BfKRn9pHAsvb1MuDZs9mHJGn6pj1KalV9EXjKLPf7XuD1wO975u1aVSvbfawEdpnlPiRJ09TPxWvP6ZncjOa6hRlfs5DkCGB1VV2S5MkzWP9Y4FiAvffee6YxpAfo9yI38EI3bdz6OfvomT2v19IcBD5yFvs8FHhWkqcDWwHbJ/kUsCrJblW1MsluwOrJVq6q04DTAJYsWeIFdZI0h/o5++ilc7nDqjoROBGgbSm8tqqOTvIuYClwSvt87lzuV5or02lVjDOHANFk+jn7aM8kX0iyOsmqJJ9vDxTPtVOApya5DnhqOy1JGqJ+uo8+DpwBHNVOH93Oe+psd15VFwIXtq9/Dhw2221Kmlseb9m09HP20aKq+nhVrW0fnwAWDTiXJGkE+ikKtyU5OsmC9nE08PNBB5MkDV8/ReGvgecDPwNWAs9r50mSNjL9nH10E+CIqNKAeBaQxkk/Zx8tS7JDz/SOST420FSSpJHop/voUVV1+7qJduTSxwwskSRpZPopCpsl2XHdRDvEdT+nskqS5pl+/ri/G/hOkrNpxjx6PnDyQFNJmrGN5YprjUY/B5pPT7KcZmTUAM+pqqsHnkySNHR9dQO1RcBCIEkbuWnfT0GStPGyKEiSOhYFSVLHoiBJ6lgUJEkdi4IkqWNRkCR1LAqSpI5FQZLUsShIkjoWBUlSx6IgSepYFCRJHW+WI80T3idBw2BLQZLUsShIkjoWBUlSx6IgSepYFCRJHYuCJKljUZAkdSwKkqSORUGS1LEoSJI6Qy8KSfZK8o0k1yS5Ksmr2/k7JTk/yXXt847DziZJm7pRtBTWAq+pqkcAhwCvSHIAcAJwQVXtB1zQTkuShmjoRaGqVlbVpe3ru4BrgD2AI4Fl7duWAc8edjZJ2tSN9JhCksXAY4CLgV2raiU0hQPYZYTRJGmTNLKikGRb4PPA8VV15zTWOzbJ8iTL16xZM7iAkrQJGklRSLI5TUH4dFWd085elWS3dvluwOrJ1q2q06pqSVUtWbRo0XACS9ImYug32UkS4KPANVX1np5F5wFLgVPa53OHnW3ceFMVScM2ijuvHQq8GLgiyWXtvDfSFIOzkhwD3AQcNYJskrRJG3pRqKqLgEyx+LBhZpEkPZBXNEuSOhYFSVLHoiBJ6lgUJEkdi4IkqTOKU1IlbaTm+tqaFac8Y063pw2zpSBJ6lgUJEkdu48kzXv9dlvZHbVhthQkSR2LgiSpY1GQJHUsCpKkjkVBktSxKEiSOhYFSVLHoiBJ6lgUJEkdr2gegbkeNEyS5ootBUlSx6IgSepYFCRJHYuCJKljUZAkdSwKkqSOp6RKGluevj18thQkSR1bCnPIbzXSeBvlbTvnyy1DbSlIkjq2FCRpgvnyrX4QbClIkjoWBUlSx6IgSep4TKEPnlUkaTIb498GWwqSpM7YFYUkT0tybZLrk5ww6jyStCkZq+6jJAuAfwSeCtwCfD/JeVV19SD2tzE2/STNb6M+HXbcWgoHA9dX1Q1V9TvgM8CRI84kSZuMsWopAHsAN/dM3wI8rvcNSY4Fjm0nf5Xk2iFlW2dn4LYh73MuzNfcMH+zm3u4Nqnceees9rnPVAvGrShkknn1gImq04DThhPnDyVZXlVLRrX/mZqvuWH+Zjf3cJl7boxb99EtwF4903sCPx1RFkna5IxbUfg+sF+ShybZAnghcN6IM0nSJmOsuo+qam2SVwL/CiwAPlZVV4041kQj67qapfmaG+ZvdnMPl7nnQKpqw++SJG0Sxq37SJI0QhYFSVLHorAeST6WZHWSK3vm7ZTk/CTXtc87jjLjZJLsleQbSa5JclWSV7fzxzp7kq2SfC/J5W3ut7bzxzr3OkkWJPlBki+102OfO8mKJFckuSzJ8nbefMi9Q5Kzk/yo/T1//DzJvX/7Wa973Jnk+HHKblFYv08AT5sw7wTggqraD7ignR43a4HXVNUjgEOAVyQ5gPHPfg/wlKp6NHAg8LQkhzD+udd5NXBNz/R8yf3nVXVgz7ny8yH3qcBXquqPgUfTfO5jn7uqrm0/6wOB/wj8GvgC45S9qnys5wEsBq7smb4W2K19vRtw7agz9vEznEszntS8yQ5sDVxKc0X72OemuabmAuApwJfmy+8KsALYecK8sc4NbA/8hPZEmfmSe5Kf4z8B/zZu2W0pTN+uVbUSoH3eZcR51ivJYuAxwMXMg+xtF8xlwGrg/KqaF7mB9wKvB37fM28+5C7gq0kuaYeQgfHPvS+wBvh42133kSTbMP65J3ohcGb7emyyWxQ2Ykm2BT4PHF9Vd446Tz+q6r5qmtZ7AgcneeSII21QkiOA1VV1yaizzMChVXUQ8Jc03YxPHHWgPiwEDgI+VFWPAe5mDLuK1qe9OPdZwOdGnWUii8L0rUqyG0D7vHrEeSaVZHOagvDpqjqnnT0vsgNU1e3AhTTHdMY996HAs5KsoBnZ9ylJPsX456aqfto+r6bp2z6Y8c99C3BL24oEOJumSIx77l5/CVxaVava6bHJblGYvvOApe3rpTT99WMlSYCPAtdU1Xt6Fo119iSLkuzQvn4QcDjwI8Y8d1WdWFV7VtVimi6Br1fV0Yx57iTbJNlu3WuaPu4rGfPcVfUz4OYk+7ezDgOuZsxzT/BX3N91BGOU3Sua1yPJmcCTaYa2XQW8BfgicBawN3ATcFRV/WJEESeV5E+BbwNXcH8f9xtpjiuMbfYkjwKW0QxxshlwVlW9Lcl/YIxz90ryZOC1VXXEuOdOsi9N6wCaLpkzqurkcc8NkORA4CPAFsANwEtpf2cY49wASbamuUXAvlV1RztvbD5zi4IkqWP3kSSpY1GQJHUsCpKkjkVBktSxKEiSOhYFSVLHoiBJ6lgUpBlK8sV2ILmr1g0ml+SYJD9OcmGSf07ygXb+oiSfT/L99nHoaNNLk/PiNWmGkuxUVb9oh+T4PvAXwL/RjMNzF/B14PKqemWSM4APVtVFSfYG/rWa+11IY2XhqANI89hxSf5z+3ov4MXAN9cNT5Dkc8AftcsPBw5ohqUCYPsk21XVXcMMLG2IRUGagXaMo8OBx1fVr5NcSHOjlKm+/W/Wvvc3QwkozZDHFKSZeTDwy7Yg/DHNbU+3Bp6UZMckC4Hn9rz/q8Ar1020A7pJY8eiIM3MV4CFSX4I/C/g/wG3An9PMxrt12iGc76jff9xwJIkP0xyNfDy4UeWNswDzdIcSrJtVf2qbSl8AfhYVX1hQ+tJ48KWgjS3TmrvMX0lzc3lvzjSNNI02VKQJHVsKUiSOhYFSVLHoiBJ6lgUJEkdi4IkqfP/AZQ/JaswHRXdAAAAAElFTkSuQmCC\n", "text/plain": [ "
" ] }, "metadata": { "needs_background": "light" }, "output_type": "display_data" } ], "source": [ "import matplotlib.pyplot as plt\n", "\n", "users.age.plot.hist(bins=30)\n", "plt.title(\"Distribution of users' ages\")\n", "plt.ylabel('count of users')\n", "plt.xlabel('age');" ] }, { "cell_type": "markdown", "id": "9422f2e9", "metadata": {}, "source": [ "### Data set preparation\n", "\n", "앞에서 설명한 것처럼 FM은 고차원 데이터 세트에서 가장 잘 작동합니다. 결과적으로 사용자 ID와 영화 ID를 한 번에 인코딩할 것입니다 (타임스탬프는 무시하겠습니다). 따라서 데이터 세트의 각 샘플은 사용자 ID 및 동영상 ID와 관련하여 두 개의 값만 1로 설정된 2,625 Boolean 벡터 (943+1682) 가 됩니다.\n", "\n", "바이너리 추천자를 만들 것입니다 (즉, 좋아요/마음에 들지 않음). 4 성급 및 5 성급 등급은 1로 설정됩니다.낮은 등급은 0으로 설정됩니다.\n", "\n", "마지막으로, Amazon SageMaker에서 FM을 구현하려면 훈련 및 테스트 데이터를 protobuf 형식의 float32 텐서에 저장해야 한다는 것입니다.(예, 복잡하게 들립니다 🙂 그러나 Amazon SageMaker SDK는 이를 처리하는 편리한 유틸리티 기능을 제공하므로 너무 걱정하지 마십시오.)\n" ] }, { "cell_type": "markdown", "id": "b2917a01", "metadata": {}, "source": [ "### Highlevel Overview\n", "\n", "구현해야 할 단계는 다음과 같습니다.\n", "\n", "* 디스크에서 MovieLens 훈련 세트와 테스트 세트를 로드합니다.\n", "* 각 세트에 대해 핫 인코딩된 데이터 샘플을 포함하는 sparse 행렬을 만듭니다.\n", "* 각 세트에 대해 등급을 유지하는 레이블 벡터를 만듭니다.\n", "* 두 세트를 모두 protobuf로 인코딩된 파일에 씁니다.\n", "* 이러한 파일을 Amazon S3 버킷에 복사합니다.\n", "* Amazon SageMaker에서 FM training 작업을 구성하고 실행합니다.\n", "* 해당 모델을 엔드포인트에 배포합니다.\n", "* 몇 가지 예측을 실행합니다.\n" ] }, { "cell_type": "code", "execution_count": 10, "id": "58869c1a", "metadata": {}, "outputs": [], "source": [ "# For each user, build a list of rated movies.\n", "# We'd need this to add random negative samples.\n", "moviesByUser = {}\n", "for userId in range(nbUsers):\n", " moviesByUser[str(userId)]=[]\n", "\n", "with open('./data/ml-100k/ua.base','r') as f:\n", " samples=csv.reader(f,delimiter='\\t')\n", " for userId,movieId,rating,timestamp in samples:\n", " moviesByUser[str(int(userId)-1)].append(int(movieId)-1) " ] }, { "cell_type": "code", "execution_count": 11, "id": "554fae5b", "metadata": {}, "outputs": [], "source": [ "def loadDataset(filename, lines, columns):\n", " # Features are one-hot encoded in a sparse matrix\n", " X = lil_matrix((lines, columns)).astype('float32')\n", " # Labels are stored in a vector\n", " Y = []\n", " line=0\n", " with open(filename,'r') as f:\n", " samples=csv.reader(f,delimiter='\\t')\n", " for userId,movieId,rating,timestamp in samples:\n", " X[line,int(userId)-1] = 1\n", " X[line,int(nbUsers)+int(movieId)-1] = 1\n", " if int(rating) >= 4:\n", " Y.append(1)\n", " else:\n", " Y.append(0)\n", " line=line+1\n", " \n", " Y=np.array(Y).astype('float32')\n", " return X,Y" ] }, { "cell_type": "markdown", "id": "14745d7b", "metadata": {}, "source": [ "* A training sparse matrix: 90,570 행과 2,625 열 (user ID 에 관련된 943 개의 원-핫 인코딩이 된 피쳐들과, movie ID 와 관련된 1682개의 원-핫 인코딩이 된 피쳐들)\n", "* A training label array: 90,570 개의 등급\n", "* A test sparse matrix: 9,430 개의 행과 2,625 열\n", "* A test label array: 9,430 개의 등급" ] }, { "cell_type": "code", "execution_count": 24, "id": "627e162b", "metadata": {}, "outputs": [], "source": [ "X_train, Y_train = loadDataset('./data/ml-100k/ua.base', nbRatingsTrain, nbFeatures)\n", "X_test, Y_test = loadDataset('./data/ml-100k/ua.test',nbRatingsTest,nbFeatures)" ] }, { "cell_type": "code", "execution_count": 25, "id": "a47400e9", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "(90570, 2625)\n", "(90570,)\n", "Training labels: 49906 zeros, 40664 ones\n", "(9430, 2625)\n", "(9430,)\n", "Test labels: 5469 zeros, 3961 ones\n" ] } ], "source": [ "print(X_train.shape)\n", "print(Y_train.shape)\n", "assert X_train.shape == (nbRatingsTrain, nbFeatures)\n", "assert Y_train.shape == (nbRatingsTrain, )\n", "zero_labels = np.count_nonzero(Y_train)\n", "print(\"Training labels: %d zeros, %d ones\" % (zero_labels, nbRatingsTrain-zero_labels))\n", "\n", "print(X_test.shape)\n", "print(Y_test.shape)\n", "assert X_test.shape == (nbRatingsTest, nbFeatures)\n", "assert Y_test.shape == (nbRatingsTest, )\n", "zero_labels = np.count_nonzero(Y_test)\n", "print(\"Test labels: %d zeros, %d ones\" % (zero_labels, nbRatingsTest-zero_labels))" ] }, { "cell_type": "code", "execution_count": 14, "id": "5fe1a092", "metadata": {}, "outputs": [], "source": [ "train_key = 'train.protobuf'\n", "train_prefix = '{}/{}'.format(prefix, 'train3')\n", "\n", "test_key = 'test.protobuf'\n", "test_prefix = '{}/{}'.format(prefix, 'test3')\n", "\n", "output_prefix = 's3://{}/{}/output'.format(bucket, prefix)" ] }, { "cell_type": "markdown", "id": "e0b39e91", "metadata": {}, "source": [ "### Convert to protobuf and save to S3\n", "\n", "다음으로 train 세트와 test 세트를 Amazon S3 에 저장된 두 개의 protobuf 파일로 작성하겠습니다. 다행스럽게도 write_spmatrix_to_sparse_tensor() 유틸리티 함수를 사용할 수 있습니다. 샘플과 레이블을 인 메모리 protobuf 로 인코딩된 sparse 다차원 배열 (일명 텐서) 에 씁니다.\n", "\n", "그런 다음 버퍼를 Amazon S3에 커밋합니다. 이 단계가 완료되면 데이터 준비가 완료되었으며 이제 training 작업에 집중할 수 있습니다.\n" ] }, { "cell_type": "code", "execution_count": 15, "id": "874fd65f", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "s3://sagemaker-ap-northeast-2-806174985048/sagemaker/movielens/train3/train.protobuf\n", "s3://sagemaker-ap-northeast-2-806174985048/sagemaker/movielens/test3/test.protobuf\n", "Output: s3://sagemaker-ap-northeast-2-806174985048/sagemaker/movielens/output\n" ] } ], "source": [ "def writeDatasetToProtobuf(X, Y, bucket, prefix, key):\n", " buf = io.BytesIO()\n", " smac.write_spmatrix_to_sparse_tensor(buf, X, Y)\n", " buf.seek(0)\n", " obj = '{}/{}'.format(prefix, key)\n", " boto3.resource('s3').Bucket(bucket).Object(obj).upload_fileobj(buf)\n", " return 's3://{}/{}'.format(bucket,obj)\n", " \n", "train_data = writeDatasetToProtobuf(X_train, Y_train, bucket, train_prefix, train_key) \n", "test_data = writeDatasetToProtobuf(X_test, Y_test, bucket, test_prefix, test_key) \n", " \n", "print(train_data)\n", "print(test_data)\n", "print('Output: {}'.format(output_prefix))" ] }, { "cell_type": "markdown", "id": "b6eefed0", "metadata": {}, "source": [ "### Run training job\n", "\n", "AWS 리전에서 사용할 수 있는 FM 컨테이너를 기반으로 Estimator를 만드는 것부터 시작하겠습니다. 그런 다음 FM 전용 하이퍼파라미터([참조](https://docs.aws.amazon.com/ko_kr/sagemaker/latest/dg/fact-machines-hyperparameters.html))를 설정해야 합니다.\n", "\n", "feature_dim: 각 샘플의 피처 수입니다 (이 경우 2,625개).\n", "predictor_type: 'binary_classifier'를 사용할 것입니다.\n", "num_factors: 사용자 및 항목 행렬의 공통 차원입니다 (게시물 시작 부분의 예제에서 설명).\n" ] }, { "cell_type": "code", "execution_count": 16, "id": "e510f883", "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "The method get_image_uri has been renamed in sagemaker>=2.\n", "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n", "Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: latest.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "835164637446.dkr.ecr.ap-northeast-2.amazonaws.com/factorization-machines:1\n" ] } ], "source": [ "container = sagemaker.amazon.amazon_estimator.get_image_uri(\n", " boto3.Session().region_name, \"factorization-machines\", \"latest\")\n", "print(container)" ] }, { "cell_type": "code", "execution_count": 27, "id": "293f1ace", "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "train_instance_count has been renamed in sagemaker>=2.\n", "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n", "train_instance_type has been renamed in sagemaker>=2.\n", "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "2022-01-10 16:13:06 Starting - Starting the training job...\n", "2022-01-10 16:13:22 Starting - Preparing the instances for trainingProfilerReport-1641831186: InProgress\n", "......\n", "2022-01-10 16:14:36 Downloading - Downloading input data...\n", "2022-01-10 16:14:58 Training - Downloading the training image......\n", "2022-01-10 16:15:58 Training - Training image download completed. Training in progress.\u001b[34mDocker entrypoint called with argument(s): train\u001b[0m\n", "\u001b[34mRunning default environment configuration script\u001b[0m\n", "\u001b[34m/opt/amazon/lib/python3.7/site-packages/jsonref.py:8: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working\n", " from collections import Mapping, MutableMapping, Sequence\u001b[0m\n", "\u001b[34m/opt/amazon/lib/python3.7/site-packages/algorithm/network_builder.py:87: DeprecationWarning: invalid escape sequence \\s\n", " \"\"\"\u001b[0m\n", "\u001b[34m/opt/amazon/lib/python3.7/site-packages/algorithm/network_builder.py:120: DeprecationWarning: invalid escape sequence \\s\n", " \"\"\"\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192 integration.py:636] worker started\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] Reading default configuration from /opt/amazon/lib/python3.7/site-packages/algorithm/resources/default-conf.json: {'epochs': 1, 'mini_batch_size': '1000', 'use_bias': 'true', 'use_linear': 'true', 'bias_lr': '0.1', 'linear_lr': '0.001', 'factors_lr': '0.0001', 'bias_wd': '0.01', 'linear_wd': '0.001', 'factors_wd': '0.00001', 'bias_init_method': 'normal', 'bias_init_sigma': '0.01', 'linear_init_method': 'normal', 'linear_init_sigma': '0.01', 'factors_init_method': 'normal', 'factors_init_sigma': '0.001', 'batch_metrics_publish_interval': '500', '_data_format': 'record', '_kvstore': 'auto', '_learning_rate': '1.0', '_log_level': 'info', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_optimizer': 'adam', '_tuning_objective_metric': '', '_use_full_symbolic': 'true', '_wd': '1.0'}\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] Merging with provided configuration from /opt/ml/input/config/hyperparameters.json: {'epochs': '100', 'feature_dim': '2625', 'mini_batch_size': '1000', 'num_factors': '64', 'predictor_type': 'binary_classifier'}\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] Final configuration: {'epochs': '100', 'mini_batch_size': '1000', 'use_bias': 'true', 'use_linear': 'true', 'bias_lr': '0.1', 'linear_lr': '0.001', 'factors_lr': '0.0001', 'bias_wd': '0.01', 'linear_wd': '0.001', 'factors_wd': '0.00001', 'bias_init_method': 'normal', 'bias_init_sigma': '0.01', 'linear_init_method': 'normal', 'linear_init_sigma': '0.01', 'factors_init_method': 'normal', 'factors_init_sigma': '0.001', 'batch_metrics_publish_interval': '500', '_data_format': 'record', '_kvstore': 'auto', '_learning_rate': '1.0', '_log_level': 'info', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_optimizer': 'adam', '_tuning_objective_metric': '', '_use_full_symbolic': 'true', '_wd': '1.0', 'feature_dim': '2625', 'num_factors': '64', 'predictor_type': 'binary_classifier'}\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 WARNING 139736811280192] Loggers have already been setup.\u001b[0m\n", "\u001b[34mProcess 1 is a worker.\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] Using default worker.\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] Checkpoint loading and saving are disabled.\u001b[0m\n", "\u001b[34m[2022-01-10 16:15:57.764] [tensorio] [warning] TensorIO is already initialized; ignoring the initialization routine.\u001b[0m\n", "\u001b[34m[2022-01-10 16:15:57.768] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 0, \"duration\": 9, \"num_examples\": 1, \"num_bytes\": 64000}\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] nvidia-smi: took 0.034 seconds to run.\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] nvidia-smi identified 0 GPUs.\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] Number of GPUs being used: 0\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] [Sparse network] Building a sparse network.\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] Create Store: local\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831357.7584572, \"EndTime\": 1641831357.8100693, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"initialize.time\": {\"sum\": 42.69981384277344, \"count\": 1, \"min\": 42.69981384277344, \"max\": 42.69981384277344}}}\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831357.8102472, \"EndTime\": 1641831357.8102849, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"Meta\": \"init_train_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1000.0, \"count\": 1, \"min\": 1000, \"max\": 1000}, \"Total Batches Seen\": {\"sum\": 1.0, \"count\": 1, \"min\": 1, \"max\": 1}, \"Max Records Seen Between Resets\": {\"sum\": 1000.0, \"count\": 1, \"min\": 1000, \"max\": 1000}, \"Max Batches Seen Between Resets\": {\"sum\": 1.0, \"count\": 1, \"min\": 1, \"max\": 1}, \"Reset Count\": {\"sum\": 1.0, \"count\": 1, \"min\": 1, \"max\": 1}, \"Number of Records Since Last Reset\": {\"sum\": 0.0, \"count\": 1, \"min\": 0, \"max\": 0}, \"Number of Batches Since Last Reset\": {\"sum\": 0.0, \"count\": 1, \"min\": 0, \"max\": 0}}}\u001b[0m\n", "\u001b[34m[16:15:57] /opt/brazil-pkg-cache/packages/AIAlgorithmsMXNet/AIAlgorithmsMXNet-1.1.x.205844.0/AL2_x86_64/generic-flavor/src/src/kvstore/./kvstore_local.h:280: Warning: non-default weights detected during kvstore pull. This call has been ignored. Please make sure to use row_sparse_pull with row_ids.\u001b[0m\n", "\u001b[34m[16:15:57] /opt/brazil-pkg-cache/packages/AIAlgorithmsMXNet/AIAlgorithmsMXNet-1.1.x.205844.0/AL2_x86_64/generic-flavor/src/src/kvstore/./kvstore_local.h:280: Warning: non-default weights detected during kvstore pull. This call has been ignored. Please make sure to use row_sparse_pull with row_ids.\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] #quality_metric: host=algo-1, epoch=0, batch=0 train binary_classification_accuracy =0.462\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] #quality_metric: host=algo-1, epoch=0, batch=0 train binary_classification_cross_entropy =0.6936287231445313\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:57 INFO 139736811280192] #quality_metric: host=algo-1, epoch=0, batch=0 train binary_f_1.000 =0.5575657894736842\u001b[0m\n", "\u001b[34m[2022-01-10 16:15:58.525] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 2, \"duration\": 687, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=0, train binary_classification_accuracy =0.5594285714285714\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=0, train binary_classification_cross_entropy =0.6900828870836195\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=0, train binary_f_1.000 =0.6984929158018229\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831357.8101814, \"EndTime\": 1641831358.5263138, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"epochs\": {\"sum\": 100.0, \"count\": 1, \"min\": 100, \"max\": 100}, \"update.time\": {\"sum\": 715.7258987426758, \"count\": 1, \"min\": 715.7258987426758, \"max\": 715.7258987426758}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:58 INFO 139736811280192] #progress_metric: host=algo-1, completed 1.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831357.8105597, \"EndTime\": 1641831358.5265293, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 91570.0, \"count\": 1, \"min\": 91570, \"max\": 91570}, \"Total Batches Seen\": {\"sum\": 92.0, \"count\": 1, \"min\": 92, \"max\": 92}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 2.0, \"count\": 1, \"min\": 2, \"max\": 2}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:58 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=126480.66931073886 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=1, batch=0 train binary_classification_accuracy =0.587\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=1, batch=0 train binary_classification_cross_entropy =0.673185302734375\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=1, batch=0 train binary_f_1.000 =0.739760554505356\u001b[0m\n", "\u001b[34m[2022-01-10 16:15:59.316] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 4, \"duration\": 786, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=1, train binary_classification_accuracy =0.5662857142857143\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=1, train binary_classification_cross_entropy =0.6834062271956559\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=1, train binary_f_1.000 =0.704784130688448\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831358.526386, \"EndTime\": 1641831359.316896, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 789.7047996520996, \"count\": 1, \"min\": 789.7047996520996, \"max\": 789.7047996520996}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:59 INFO 139736811280192] #progress_metric: host=algo-1, completed 2.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831358.5271335, \"EndTime\": 1641831359.3172393, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 182140.0, \"count\": 1, \"min\": 182140, \"max\": 182140}, \"Total Batches Seen\": {\"sum\": 183.0, \"count\": 1, \"min\": 183, \"max\": 183}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 3.0, \"count\": 1, \"min\": 3, \"max\": 3}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:59 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=114610.01786076328 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=2, batch=0 train binary_classification_accuracy =0.587\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=2, batch=0 train binary_classification_cross_entropy =0.6666475219726562\u001b[0m\n", "\u001b[34m[01/10/2022 16:15:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=2, batch=0 train binary_f_1.000 =0.739760554505356\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:00.156] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 6, \"duration\": 836, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=2, train binary_classification_accuracy =0.5760219780219781\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=2, train binary_classification_cross_entropy =0.6782808717161745\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=2, train binary_f_1.000 =0.7075348696179503\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831359.316982, \"EndTime\": 1641831360.1572182, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 839.2188549041748, \"count\": 1, \"min\": 839.2188549041748, \"max\": 839.2188549041748}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #progress_metric: host=algo-1, completed 3.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831359.3179624, \"EndTime\": 1641831360.157496, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 272710.0, \"count\": 1, \"min\": 272710, \"max\": 272710}, \"Total Batches Seen\": {\"sum\": 274.0, \"count\": 1, \"min\": 274, \"max\": 274}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 4.0, \"count\": 1, \"min\": 4, \"max\": 4}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=107861.97337737028 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=3, batch=0 train binary_classification_accuracy =0.587\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=3, batch=0 train binary_classification_cross_entropy =0.6609312744140625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=3, batch=0 train binary_f_1.000 =0.739760554505356\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:00.998] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 8, \"duration\": 837, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=3, train binary_classification_accuracy =0.586021978021978\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=3, train binary_classification_cross_entropy =0.6737329282655821\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=3, train binary_f_1.000 =0.7099431774434469\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831360.1573062, \"EndTime\": 1641831360.998997, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 840.705394744873, \"count\": 1, \"min\": 840.705394744873, \"max\": 840.705394744873}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #progress_metric: host=algo-1, completed 4.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831360.1582267, \"EndTime\": 1641831360.9996068, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 363280.0, \"count\": 1, \"min\": 363280, \"max\": 363280}, \"Total Batches Seen\": {\"sum\": 365.0, \"count\": 1, \"min\": 365, \"max\": 365}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 5.0, \"count\": 1, \"min\": 5, \"max\": 5}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:00 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=107626.42251428562 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=4, batch=0 train binary_classification_accuracy =0.587\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=4, batch=0 train binary_classification_cross_entropy =0.6559242553710938\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=4, batch=0 train binary_f_1.000 =0.739760554505356\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:01.708] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 10, \"duration\": 705, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=4, train binary_classification_accuracy =0.5944945054945054\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=4, train binary_classification_cross_entropy =0.6697046361231542\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=4, train binary_f_1.000 =0.7120326510226856\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831360.9994118, \"EndTime\": 1641831361.7099712, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 709.6295356750488, \"count\": 1, \"min\": 709.6295356750488, \"max\": 709.6295356750488}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:01 INFO 139736811280192] #progress_metric: host=algo-1, completed 5.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831361.0002947, \"EndTime\": 1641831361.7105446, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 453850.0, \"count\": 1, \"min\": 453850, \"max\": 453850}, \"Total Batches Seen\": {\"sum\": 456.0, \"count\": 1, \"min\": 456, \"max\": 456}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 6.0, \"count\": 1, \"min\": 6, \"max\": 6}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:01 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=127491.23578310273 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=5, batch=0 train binary_classification_accuracy =0.588\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=5, batch=0 train binary_classification_cross_entropy =0.651530029296875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=5, batch=0 train binary_f_1.000 =0.7402269861286255\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:02.430] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 12, \"duration\": 717, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:02 INFO 139736811280192] #quality_metric: host=algo-1, epoch=5, train binary_classification_accuracy =0.6014285714285714\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:02 INFO 139736811280192] #quality_metric: host=algo-1, epoch=5, train binary_classification_cross_entropy =0.6661233916230254\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:02 INFO 139736811280192] #quality_metric: host=algo-1, epoch=5, train binary_f_1.000 =0.7136880328386486\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831361.7102625, \"EndTime\": 1641831362.431644, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 720.3893661499023, \"count\": 1, \"min\": 720.3893661499023, \"max\": 720.3893661499023}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:02 INFO 139736811280192] #progress_metric: host=algo-1, completed 6.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831361.7112288, \"EndTime\": 1641831362.4319355, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 544420.0, \"count\": 1, \"min\": 544420, \"max\": 544420}, \"Total Batches Seen\": {\"sum\": 547.0, \"count\": 1, \"min\": 547, \"max\": 547}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:02 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=125646.83013051617 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:02 INFO 139736811280192] #quality_metric: host=algo-1, epoch=6, batch=0 train binary_classification_accuracy =0.592\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:02 INFO 139736811280192] #quality_metric: host=algo-1, epoch=6, batch=0 train binary_classification_cross_entropy =0.6476605834960938\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:02 INFO 139736811280192] #quality_metric: host=algo-1, epoch=6, batch=0 train binary_f_1.000 =0.7414448669201521\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:03.108] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 14, \"duration\": 673, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=6, train binary_classification_accuracy =0.6086923076923076\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=6, train binary_classification_cross_entropy =0.6629218132941277\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=6, train binary_f_1.000 =0.7159664669894471\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831362.4317114, \"EndTime\": 1641831363.1089876, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 676.4271259307861, \"count\": 1, \"min\": 676.4271259307861, \"max\": 676.4271259307861}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #progress_metric: host=algo-1, completed 7.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831362.4325285, \"EndTime\": 1641831363.1093192, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 634990.0, \"count\": 1, \"min\": 634990, \"max\": 634990}, \"Total Batches Seen\": {\"sum\": 638.0, \"count\": 1, \"min\": 638, \"max\": 638}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 8.0, \"count\": 1, \"min\": 8, \"max\": 8}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=133795.65640253856 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=7, batch=0 train binary_classification_accuracy =0.609\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=7, batch=0 train binary_classification_cross_entropy =0.6442371826171875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=7, batch=0 train binary_f_1.000 =0.7485530546623794\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:03.772] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 16, \"duration\": 660, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=7, train binary_classification_accuracy =0.6153846153846154\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=7, train binary_classification_cross_entropy =0.6600404300899296\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=7, train binary_f_1.000 =0.7180148243635192\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831363.1090946, \"EndTime\": 1641831363.773453, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 663.4180545806885, \"count\": 1, \"min\": 663.4180545806885, \"max\": 663.4180545806885}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #progress_metric: host=algo-1, completed 8.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831363.110004, \"EndTime\": 1641831363.773741, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 725560.0, \"count\": 1, \"min\": 725560, \"max\": 725560}, \"Total Batches Seen\": {\"sum\": 729.0, \"count\": 1, \"min\": 729, \"max\": 729}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 9.0, \"count\": 1, \"min\": 9, \"max\": 9}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=136425.23501579268 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=8, batch=0 train binary_classification_accuracy =0.617\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=8, batch=0 train binary_classification_cross_entropy =0.6411910400390625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:03 INFO 139736811280192] #quality_metric: host=algo-1, epoch=8, batch=0 train binary_f_1.000 =0.751137102014295\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:04.437] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 18, \"duration\": 661, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:04 INFO 139736811280192] #quality_metric: host=algo-1, epoch=8, train binary_classification_accuracy =0.6228571428571429\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:04 INFO 139736811280192] #quality_metric: host=algo-1, epoch=8, train binary_classification_cross_entropy =0.6574277531550481\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:04 INFO 139736811280192] #quality_metric: host=algo-1, epoch=8, train binary_f_1.000 =0.7206758472507081\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831363.7735434, \"EndTime\": 1641831364.439301, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 664.7710800170898, \"count\": 1, \"min\": 664.7710800170898, \"max\": 664.7710800170898}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:04 INFO 139736811280192] #progress_metric: host=algo-1, completed 9.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831363.7744734, \"EndTime\": 1641831364.439646, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 816130.0, \"count\": 1, \"min\": 816130, \"max\": 816130}, \"Total Batches Seen\": {\"sum\": 820.0, \"count\": 1, \"min\": 820, \"max\": 820}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 10.0, \"count\": 1, \"min\": 10, \"max\": 10}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:04 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=136116.19499096507 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:04 INFO 139736811280192] #quality_metric: host=algo-1, epoch=9, batch=0 train binary_classification_accuracy =0.632\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:04 INFO 139736811280192] #quality_metric: host=algo-1, epoch=9, batch=0 train binary_classification_cross_entropy =0.6384625854492187\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:04 INFO 139736811280192] #quality_metric: host=algo-1, epoch=9, batch=0 train binary_f_1.000 =0.7575757575757576\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:05.154] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 20, \"duration\": 711, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=9, train binary_classification_accuracy =0.6299120879120879\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=9, train binary_classification_cross_entropy =0.655039790226863\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=9, train binary_f_1.000 =0.7234294161123429\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831364.4393888, \"EndTime\": 1641831365.1548955, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 714.3471240997314, \"count\": 1, \"min\": 714.3471240997314, \"max\": 714.3471240997314}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #progress_metric: host=algo-1, completed 10.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831364.4405146, \"EndTime\": 1641831365.1551716, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 906700.0, \"count\": 1, \"min\": 906700, \"max\": 906700}, \"Total Batches Seen\": {\"sum\": 911.0, \"count\": 1, \"min\": 911, \"max\": 911}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 11.0, \"count\": 1, \"min\": 11, \"max\": 11}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=126705.65114413557 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=10, batch=0 train binary_classification_accuracy =0.641\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=10, batch=0 train binary_classification_cross_entropy =0.63600048828125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=10, batch=0 train binary_f_1.000 =0.7614617940199335\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:05.875] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 22, \"duration\": 717, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=10, train binary_classification_accuracy =0.6364835164835165\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=10, train binary_classification_cross_entropy =0.6528391763875773\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=10, train binary_f_1.000 =0.726163474114667\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831365.1549845, \"EndTime\": 1641831365.8769999, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 721.0531234741211, \"count\": 1, \"min\": 721.0531234741211, \"max\": 721.0531234741211}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #progress_metric: host=algo-1, completed 11.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831365.1559193, \"EndTime\": 1641831365.8773415, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 997270.0, \"count\": 1, \"min\": 997270, \"max\": 997270}, \"Total Batches Seen\": {\"sum\": 1002.0, \"count\": 1, \"min\": 1002, \"max\": 1002}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 12.0, \"count\": 1, \"min\": 12, \"max\": 12}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=125513.36180757584 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=11, batch=0 train binary_classification_accuracy =0.65\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=11, batch=0 train binary_classification_cross_entropy =0.6337610473632812\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:05 INFO 139736811280192] #quality_metric: host=algo-1, epoch=11, batch=0 train binary_f_1.000 =0.766042780748663\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:06.735] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 24, \"duration\": 854, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:06 INFO 139736811280192] #quality_metric: host=algo-1, epoch=11, train binary_classification_accuracy =0.6417692307692308\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:06 INFO 139736811280192] #quality_metric: host=algo-1, epoch=11, train binary_classification_cross_entropy =0.6507943356692136\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:06 INFO 139736811280192] #quality_metric: host=algo-1, epoch=11, train binary_f_1.000 =0.7284480245237283\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831365.8770685, \"EndTime\": 1641831366.736545, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 858.4949970245361, \"count\": 1, \"min\": 858.4949970245361, \"max\": 858.4949970245361}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:06 INFO 139736811280192] #progress_metric: host=algo-1, completed 12.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831365.8780181, \"EndTime\": 1641831366.7370985, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1087840.0, \"count\": 1, \"min\": 1087840, \"max\": 1087840}, \"Total Batches Seen\": {\"sum\": 1093.0, \"count\": 1, \"min\": 1093, \"max\": 1093}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 13.0, \"count\": 1, \"min\": 13, \"max\": 13}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:06 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=105402.68093943922 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:06 INFO 139736811280192] #quality_metric: host=algo-1, epoch=12, batch=0 train binary_classification_accuracy =0.657\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:06 INFO 139736811280192] #quality_metric: host=algo-1, epoch=12, batch=0 train binary_classification_cross_entropy =0.63170703125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:06 INFO 139736811280192] #quality_metric: host=algo-1, epoch=12, batch=0 train binary_f_1.000 =0.769334229993275\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:07.481] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 26, \"duration\": 741, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:07 INFO 139736811280192] #quality_metric: host=algo-1, epoch=12, train binary_classification_accuracy =0.6468681318681319\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:07 INFO 139736811280192] #quality_metric: host=algo-1, epoch=12, train binary_classification_cross_entropy =0.6488786661336711\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:07 INFO 139736811280192] #quality_metric: host=algo-1, epoch=12, train binary_f_1.000 =0.7307070249976955\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831366.736666, \"EndTime\": 1641831367.4831474, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 745.1605796813965, \"count\": 1, \"min\": 745.1605796813965, \"max\": 745.1605796813965}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:07 INFO 139736811280192] #progress_metric: host=algo-1, completed 13.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831366.7379515, \"EndTime\": 1641831367.4834309, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1178410.0, \"count\": 1, \"min\": 1178410, \"max\": 1178410}, \"Total Batches Seen\": {\"sum\": 1184.0, \"count\": 1, \"min\": 1184, \"max\": 1184}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 14.0, \"count\": 1, \"min\": 14, \"max\": 14}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:07 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=121472.02042407978 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:07 INFO 139736811280192] #quality_metric: host=algo-1, epoch=13, batch=0 train binary_classification_accuracy =0.667\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:07 INFO 139736811280192] #quality_metric: host=algo-1, epoch=13, batch=0 train binary_classification_cross_entropy =0.6298068237304687\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:07 INFO 139736811280192] #quality_metric: host=algo-1, epoch=13, batch=0 train binary_f_1.000 =0.7745429925524713\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:08.138] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 28, \"duration\": 652, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=13, train binary_classification_accuracy =0.6519340659340659\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=13, train binary_classification_cross_entropy =0.64706982086517\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=13, train binary_f_1.000 =0.7331052613839361\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831367.483273, \"EndTime\": 1641831368.1392643, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 655.2455425262451, \"count\": 1, \"min\": 655.2455425262451, \"max\": 655.2455425262451}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #progress_metric: host=algo-1, completed 14.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831367.4839895, \"EndTime\": 1641831368.1395369, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1268980.0, \"count\": 1, \"min\": 1268980, \"max\": 1268980}, \"Total Batches Seen\": {\"sum\": 1275.0, \"count\": 1, \"min\": 1275, \"max\": 1275}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 15.0, \"count\": 1, \"min\": 15, \"max\": 15}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=138132.07091503317 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=14, batch=0 train binary_classification_accuracy =0.668\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=14, batch=0 train binary_classification_cross_entropy =0.6280338134765625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=14, batch=0 train binary_f_1.000 =0.7747625508819539\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:08.787] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 30, \"duration\": 645, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=14, train binary_classification_accuracy =0.6553846153846153\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=14, train binary_classification_cross_entropy =0.645349119081602\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=14, train binary_f_1.000 =0.7345926640599875\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831368.1393476, \"EndTime\": 1641831368.7884517, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 648.1986045837402, \"count\": 1, \"min\": 648.1986045837402, \"max\": 648.1986045837402}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #progress_metric: host=algo-1, completed 15.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831368.1402209, \"EndTime\": 1641831368.7888422, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1359550.0, \"count\": 1, \"min\": 1359550, \"max\": 1359550}, \"Total Batches Seen\": {\"sum\": 1366.0, \"count\": 1, \"min\": 1366, \"max\": 1366}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 16.0, \"count\": 1, \"min\": 16, \"max\": 16}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=139582.45329468843 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=15, batch=0 train binary_classification_accuracy =0.674\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=15, batch=0 train binary_classification_cross_entropy =0.6263656616210938\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:08 INFO 139736811280192] #quality_metric: host=algo-1, epoch=15, batch=0 train binary_f_1.000 =0.7773224043715847\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:09.423] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 32, \"duration\": 631, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:09 INFO 139736811280192] #quality_metric: host=algo-1, epoch=15, train binary_classification_accuracy =0.6595054945054946\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:09 INFO 139736811280192] #quality_metric: host=algo-1, epoch=15, train binary_classification_cross_entropy =0.6437009498680031\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:09 INFO 139736811280192] #quality_metric: host=algo-1, epoch=15, train binary_f_1.000 =0.736600501551409\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831368.7885988, \"EndTime\": 1641831369.4238536, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 634.207010269165, \"count\": 1, \"min\": 634.207010269165, \"max\": 634.207010269165}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:09 INFO 139736811280192] #progress_metric: host=algo-1, completed 16.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831368.7896147, \"EndTime\": 1641831369.4241762, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 15, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1450120.0, \"count\": 1, \"min\": 1450120, \"max\": 1450120}, \"Total Batches Seen\": {\"sum\": 1457.0, \"count\": 1, \"min\": 1457, \"max\": 1457}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 17.0, \"count\": 1, \"min\": 17, \"max\": 17}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:09 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=142697.2166542017 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:09 INFO 139736811280192] #quality_metric: host=algo-1, epoch=16, batch=0 train binary_classification_accuracy =0.674\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:09 INFO 139736811280192] #quality_metric: host=algo-1, epoch=16, batch=0 train binary_classification_cross_entropy =0.6247835083007812\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:09 INFO 139736811280192] #quality_metric: host=algo-1, epoch=16, batch=0 train binary_f_1.000 =0.7767123287671233\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:10.056] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 34, \"duration\": 629, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=16, train binary_classification_accuracy =0.6633626373626373\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=16, train binary_classification_cross_entropy =0.6421123724298162\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=16, train binary_f_1.000 =0.73858652057413\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831369.4239364, \"EndTime\": 1641831370.057437, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 632.5852870941162, \"count\": 1, \"min\": 632.5852870941162, \"max\": 632.5852870941162}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #progress_metric: host=algo-1, completed 17.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831369.424817, \"EndTime\": 1641831370.0578096, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 16, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1540690.0, \"count\": 1, \"min\": 1540690, \"max\": 1540690}, \"Total Batches Seen\": {\"sum\": 1548.0, \"count\": 1, \"min\": 1548, \"max\": 1548}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 18.0, \"count\": 1, \"min\": 18, \"max\": 18}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=143050.85028841527 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=17, batch=0 train binary_classification_accuracy =0.676\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=17, batch=0 train binary_classification_cross_entropy =0.623271728515625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=17, batch=0 train binary_f_1.000 =0.7777777777777778\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:10.673] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 36, \"duration\": 613, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=17, train binary_classification_accuracy =0.6670769230769231\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=17, train binary_classification_cross_entropy =0.6405726398845295\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=17, train binary_f_1.000 =0.7406075550532553\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831370.0575538, \"EndTime\": 1641831370.6742342, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 615.746021270752, \"count\": 1, \"min\": 615.746021270752, \"max\": 615.746021270752}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #progress_metric: host=algo-1, completed 18.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831370.0584576, \"EndTime\": 1641831370.6745129, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 17, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1631260.0, \"count\": 1, \"min\": 1631260, \"max\": 1631260}, \"Total Batches Seen\": {\"sum\": 1639.0, \"count\": 1, \"min\": 1639, \"max\": 1639}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 19.0, \"count\": 1, \"min\": 19, \"max\": 19}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=146983.04210906313 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=18, batch=0 train binary_classification_accuracy =0.677\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=18, batch=0 train binary_classification_cross_entropy =0.6218172607421875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:10 INFO 139736811280192] #quality_metric: host=algo-1, epoch=18, batch=0 train binary_f_1.000 =0.7783115991763898\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:11.363] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 38, \"duration\": 686, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:11 INFO 139736811280192] #quality_metric: host=algo-1, epoch=18, train binary_classification_accuracy =0.6701318681318681\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:11 INFO 139736811280192] #quality_metric: host=algo-1, epoch=18, train binary_classification_cross_entropy =0.6390729128659427\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:11 INFO 139736811280192] #quality_metric: host=algo-1, epoch=18, train binary_f_1.000 =0.7422551174611898\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831370.674319, \"EndTime\": 1641831371.3645408, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 689.4032955169678, \"count\": 1, \"min\": 689.4032955169678, \"max\": 689.4032955169678}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:11 INFO 139736811280192] #progress_metric: host=algo-1, completed 19.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831370.6751065, \"EndTime\": 1641831371.3648643, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 18, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1721830.0, \"count\": 1, \"min\": 1721830, \"max\": 1721830}, \"Total Batches Seen\": {\"sum\": 1730.0, \"count\": 1, \"min\": 1730, \"max\": 1730}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 20.0, \"count\": 1, \"min\": 20, \"max\": 20}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:11 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=131282.90496491548 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:11 INFO 139736811280192] #quality_metric: host=algo-1, epoch=19, batch=0 train binary_classification_accuracy =0.68\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:11 INFO 139736811280192] #quality_metric: host=algo-1, epoch=19, batch=0 train binary_classification_cross_entropy =0.6204092407226562\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:11 INFO 139736811280192] #quality_metric: host=algo-1, epoch=19, batch=0 train binary_f_1.000 =0.7799174690508941\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:12.017] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 40, \"duration\": 648, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=19, train binary_classification_accuracy =0.6730659340659341\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=19, train binary_classification_cross_entropy =0.6376059382512019\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=19, train binary_f_1.000 =0.7437975250381061\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831371.3646238, \"EndTime\": 1641831372.0182035, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 652.5850296020508, \"count\": 1, \"min\": 652.5850296020508, \"max\": 652.5850296020508}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #progress_metric: host=algo-1, completed 20.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831371.3655903, \"EndTime\": 1641831372.0184014, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 19, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1812400.0, \"count\": 1, \"min\": 1812400, \"max\": 1812400}, \"Total Batches Seen\": {\"sum\": 1821.0, \"count\": 1, \"min\": 1821, \"max\": 1821}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 21.0, \"count\": 1, \"min\": 21, \"max\": 21}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=138714.3963020022 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=20, batch=0 train binary_classification_accuracy =0.686\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=20, batch=0 train binary_classification_cross_entropy =0.6190389404296875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=20, batch=0 train binary_f_1.000 =0.7831491712707183\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:12.642] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 42, \"duration\": 620, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=20, train binary_classification_accuracy =0.675923076923077\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=20, train binary_classification_cross_entropy =0.6361658003251631\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=20, train binary_f_1.000 =0.7453215540989836\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831372.0182672, \"EndTime\": 1641831372.6428454, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 623.8105297088623, \"count\": 1, \"min\": 623.8105297088623, \"max\": 623.8105297088623}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #progress_metric: host=algo-1, completed 21.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831372.0190048, \"EndTime\": 1641831372.6430862, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 20, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1902970.0, \"count\": 1, \"min\": 1902970, \"max\": 1902970}, \"Total Batches Seen\": {\"sum\": 1912.0, \"count\": 1, \"min\": 1912, \"max\": 1912}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 22.0, \"count\": 1, \"min\": 22, \"max\": 22}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=145093.48862808666 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=21, batch=0 train binary_classification_accuracy =0.69\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=21, batch=0 train binary_classification_cross_entropy =0.6176990966796875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:12 INFO 139736811280192] #quality_metric: host=algo-1, epoch=21, batch=0 train binary_f_1.000 =0.7853185595567868\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:13.278] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 44, \"duration\": 631, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=21, train binary_classification_accuracy =0.6785824175824176\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=21, train binary_classification_cross_entropy =0.6347477027976905\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=21, train binary_f_1.000 =0.7467465560683332\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831372.6429286, \"EndTime\": 1641831373.279747, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 635.9765529632568, \"count\": 1, \"min\": 635.9765529632568, \"max\": 635.9765529632568}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #progress_metric: host=algo-1, completed 22.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831372.6437411, \"EndTime\": 1641831373.279985, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 21, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1993540.0, \"count\": 1, \"min\": 1993540, \"max\": 1993540}, \"Total Batches Seen\": {\"sum\": 2003.0, \"count\": 1, \"min\": 2003, \"max\": 2003}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 23.0, \"count\": 1, \"min\": 23, \"max\": 23}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=142331.8337285558 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=22, batch=0 train binary_classification_accuracy =0.69\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=22, batch=0 train binary_classification_cross_entropy =0.6163837890625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=22, batch=0 train binary_f_1.000 =0.7850208044382802\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:13.887] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 46, \"duration\": 605, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=22, train binary_classification_accuracy =0.6815164835164835\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=22, train binary_classification_cross_entropy =0.6333478024660886\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=22, train binary_f_1.000 =0.7483982984634083\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831373.2798266, \"EndTime\": 1641831373.8885927, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 608.1118583679199, \"count\": 1, \"min\": 608.1118583679199, \"max\": 608.1118583679199}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #progress_metric: host=algo-1, completed 23.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831373.2804494, \"EndTime\": 1641831373.8889139, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 22, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 2084110.0, \"count\": 1, \"min\": 2084110, \"max\": 2084110}, \"Total Batches Seen\": {\"sum\": 2094.0, \"count\": 1, \"min\": 2094, \"max\": 2094}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 24.0, \"count\": 1, \"min\": 24, \"max\": 24}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=148818.32199731257 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=23, batch=0 train binary_classification_accuracy =0.691\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=23, batch=0 train binary_classification_cross_entropy =0.6150882568359375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:13 INFO 139736811280192] #quality_metric: host=algo-1, epoch=23, batch=0 train binary_f_1.000 =0.7849686847599165\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:14.510] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 48, \"duration\": 617, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:14 INFO 139736811280192] #quality_metric: host=algo-1, epoch=23, train binary_classification_accuracy =0.6834065934065934\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:14 INFO 139736811280192] #quality_metric: host=algo-1, epoch=23, train binary_classification_cross_entropy =0.6319630033052884\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:14 INFO 139736811280192] #quality_metric: host=algo-1, epoch=23, train binary_f_1.000 =0.7492995005134095\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831373.8887036, \"EndTime\": 1641831374.5113945, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 621.7827796936035, \"count\": 1, \"min\": 621.7827796936035, \"max\": 621.7827796936035}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:14 INFO 139736811280192] #progress_metric: host=algo-1, completed 24.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831373.8895822, \"EndTime\": 1641831374.511674, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 23, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 2174680.0, \"count\": 1, \"min\": 2174680, \"max\": 2174680}, \"Total Batches Seen\": {\"sum\": 2185.0, \"count\": 1, \"min\": 2185, \"max\": 2185}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 25.0, \"count\": 1, \"min\": 25, \"max\": 25}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:14 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=145555.59087134927 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:14 INFO 139736811280192] #quality_metric: host=algo-1, epoch=24, batch=0 train binary_classification_accuracy =0.696\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:14 INFO 139736811280192] #quality_metric: host=algo-1, epoch=24, batch=0 train binary_classification_cross_entropy =0.613808837890625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:14 INFO 139736811280192] #quality_metric: host=algo-1, epoch=24, batch=0 train binary_f_1.000 =0.7877094972067039\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:15.141] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 50, \"duration\": 627, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=24, train binary_classification_accuracy =0.6863076923076923\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=24, train binary_classification_cross_entropy =0.6305909135420243\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=24, train binary_f_1.000 =0.7509379307937948\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831374.5114791, \"EndTime\": 1641831375.1423178, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 629.9262046813965, \"count\": 1, \"min\": 629.9262046813965, \"max\": 629.9262046813965}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #progress_metric: host=algo-1, completed 25.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831374.5123532, \"EndTime\": 1641831375.1426165, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 24, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 2265250.0, \"count\": 1, \"min\": 2265250, \"max\": 2265250}, \"Total Batches Seen\": {\"sum\": 2276.0, \"count\": 1, \"min\": 2276, \"max\": 2276}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 26.0, \"count\": 1, \"min\": 26, \"max\": 26}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=143672.3285221699 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=25, batch=0 train binary_classification_accuracy =0.694\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=25, batch=0 train binary_classification_cross_entropy =0.6125425415039063\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=25, batch=0 train binary_f_1.000 =0.786013986013986\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:15.767] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 52, \"duration\": 622, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=25, train binary_classification_accuracy =0.6886043956043956\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=25, train binary_classification_cross_entropy =0.6292296598665007\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=25, train binary_f_1.000 =0.7521364530942488\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831375.1424434, \"EndTime\": 1641831375.7684565, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 625.1928806304932, \"count\": 1, \"min\": 625.1928806304932, \"max\": 625.1928806304932}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #progress_metric: host=algo-1, completed 26.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831375.1432314, \"EndTime\": 1641831375.7687705, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 25, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 2355820.0, \"count\": 1, \"min\": 2355820, \"max\": 2355820}, \"Total Batches Seen\": {\"sum\": 2367.0, \"count\": 1, \"min\": 2367, \"max\": 2367}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 27.0, \"count\": 1, \"min\": 27, \"max\": 27}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144755.78276464797 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=26, batch=0 train binary_classification_accuracy =0.695\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=26, batch=0 train binary_classification_cross_entropy =0.611286865234375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:15 INFO 139736811280192] #quality_metric: host=algo-1, epoch=26, batch=0 train binary_f_1.000 =0.7859649122807018\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:16.409] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 54, \"duration\": 638, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:16 INFO 139736811280192] #quality_metric: host=algo-1, epoch=26, train binary_classification_accuracy =0.6904615384615385\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:16 INFO 139736811280192] #quality_metric: host=algo-1, epoch=26, train binary_classification_cross_entropy =0.6278778082879035\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:16 INFO 139736811280192] #quality_metric: host=algo-1, epoch=26, train binary_f_1.000 =0.753124507002752\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831375.7685435, \"EndTime\": 1641831376.4104419, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 641.0236358642578, \"count\": 1, \"min\": 641.0236358642578, \"max\": 641.0236358642578}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:16 INFO 139736811280192] #progress_metric: host=algo-1, completed 27.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831375.769387, \"EndTime\": 1641831376.410727, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 26, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 2446390.0, \"count\": 1, \"min\": 2446390, \"max\": 2446390}, \"Total Batches Seen\": {\"sum\": 2458.0, \"count\": 1, \"min\": 2458, \"max\": 2458}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 28.0, \"count\": 1, \"min\": 28, \"max\": 28}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:16 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=141191.07359344367 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:16 INFO 139736811280192] #quality_metric: host=algo-1, epoch=27, batch=0 train binary_classification_accuracy =0.696\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:16 INFO 139736811280192] #quality_metric: host=algo-1, epoch=27, batch=0 train binary_classification_cross_entropy =0.6100401611328125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:16 INFO 139736811280192] #quality_metric: host=algo-1, epoch=27, batch=0 train binary_f_1.000 =0.7862165963431786\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:17.059] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 56, \"duration\": 646, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=27, train binary_classification_accuracy =0.6925604395604396\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=27, train binary_classification_cross_entropy =0.6265343305986006\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=27, train binary_f_1.000 =0.7541542544310583\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831376.4105291, \"EndTime\": 1641831377.0601914, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 648.7727165222168, \"count\": 1, \"min\": 648.7727165222168, \"max\": 648.7727165222168}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #progress_metric: host=algo-1, completed 28.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831376.4113882, \"EndTime\": 1641831377.0604656, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 27, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 2536960.0, \"count\": 1, \"min\": 2536960, \"max\": 2536960}, \"Total Batches Seen\": {\"sum\": 2549.0, \"count\": 1, \"min\": 2549, \"max\": 2549}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 29.0, \"count\": 1, \"min\": 29, \"max\": 29}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=139512.68495677208 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=28, batch=0 train binary_classification_accuracy =0.696\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=28, batch=0 train binary_classification_cross_entropy =0.6088012084960938\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=28, batch=0 train binary_f_1.000 =0.7859154929577464\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:17.672] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 58, \"duration\": 609, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=28, train binary_classification_accuracy =0.6943516483516483\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=28, train binary_classification_cross_entropy =0.6251984709016569\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=28, train binary_f_1.000 =0.7550376946382019\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831377.060274, \"EndTime\": 1641831377.6731606, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 612.0843887329102, \"count\": 1, \"min\": 612.0843887329102, \"max\": 612.0843887329102}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #progress_metric: host=algo-1, completed 29.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831377.0610468, \"EndTime\": 1641831377.6734583, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 28, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 2627530.0, \"count\": 1, \"min\": 2627530, \"max\": 2627530}, \"Total Batches Seen\": {\"sum\": 2640.0, \"count\": 1, \"min\": 2640, \"max\": 2640}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 30.0, \"count\": 1, \"min\": 30, \"max\": 30}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=147858.40633784342 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=29, batch=0 train binary_classification_accuracy =0.698\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=29, batch=0 train binary_classification_cross_entropy =0.6075689697265625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:17 INFO 139736811280192] #quality_metric: host=algo-1, epoch=29, batch=0 train binary_f_1.000 =0.786723163841808\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:18.296] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 60, \"duration\": 620, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=29, train binary_classification_accuracy =0.6963406593406594\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=29, train binary_classification_cross_entropy =0.6238697503058465\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=29, train binary_f_1.000 =0.7561227461674919\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831377.6732306, \"EndTime\": 1641831378.2969182, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 622.7471828460693, \"count\": 1, \"min\": 622.7471828460693, \"max\": 622.7471828460693}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #progress_metric: host=algo-1, completed 30.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831377.6741455, \"EndTime\": 1641831378.297133, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 29, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 2718100.0, \"count\": 1, \"min\": 2718100, \"max\": 2718100}, \"Total Batches Seen\": {\"sum\": 2731.0, \"count\": 1, \"min\": 2731, \"max\": 2731}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 31.0, \"count\": 1, \"min\": 31, \"max\": 31}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=145356.0350068416 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=30, batch=0 train binary_classification_accuracy =0.698\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=30, batch=0 train binary_classification_cross_entropy =0.6063427734375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=30, batch=0 train binary_f_1.000 =0.786723163841808\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:18.914] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 62, \"duration\": 614, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=30, train binary_classification_accuracy =0.6986263736263736\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=30, train binary_classification_cross_entropy =0.6225478884518801\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=30, train binary_f_1.000 =0.7573846194676174\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831378.2969923, \"EndTime\": 1641831378.9148133, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 617.0320510864258, \"count\": 1, \"min\": 617.0320510864258, \"max\": 617.0320510864258}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #progress_metric: host=algo-1, completed 31.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831378.2977474, \"EndTime\": 1641831378.9151168, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 30, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 2808670.0, \"count\": 1, \"min\": 2808670, \"max\": 2808670}, \"Total Batches Seen\": {\"sum\": 2822.0, \"count\": 1, \"min\": 2822, \"max\": 2822}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 32.0, \"count\": 1, \"min\": 32, \"max\": 32}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=146667.57524723347 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=31, batch=0 train binary_classification_accuracy =0.7\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=31, batch=0 train binary_classification_cross_entropy =0.6051224365234374\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:18 INFO 139736811280192] #quality_metric: host=algo-1, epoch=31, batch=0 train binary_f_1.000 =0.7875354107648725\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:19.552] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 64, \"duration\": 635, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:19 INFO 139736811280192] #quality_metric: host=algo-1, epoch=31, train binary_classification_accuracy =0.7002637362637363\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:19 INFO 139736811280192] #quality_metric: host=algo-1, epoch=31, train binary_classification_cross_entropy =0.6212327565622854\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:19 INFO 139736811280192] #quality_metric: host=algo-1, epoch=31, train binary_f_1.000 =0.7582000638275238\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831378.9149034, \"EndTime\": 1641831379.5539746, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 638.1435394287109, \"count\": 1, \"min\": 638.1435394287109, \"max\": 638.1435394287109}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:19 INFO 139736811280192] #progress_metric: host=algo-1, completed 32.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831378.9157853, \"EndTime\": 1641831379.5543685, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 31, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 2899240.0, \"count\": 1, \"min\": 2899240, \"max\": 2899240}, \"Total Batches Seen\": {\"sum\": 2913.0, \"count\": 1, \"min\": 2913, \"max\": 2913}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 33.0, \"count\": 1, \"min\": 33, \"max\": 33}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:19 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=141800.48588968415 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:19 INFO 139736811280192] #quality_metric: host=algo-1, epoch=32, batch=0 train binary_classification_accuracy =0.707\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:19 INFO 139736811280192] #quality_metric: host=algo-1, epoch=32, batch=0 train binary_classification_cross_entropy =0.6039075927734375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:19 INFO 139736811280192] #quality_metric: host=algo-1, epoch=32, batch=0 train binary_f_1.000 =0.7914590747330961\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:20.179] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 66, \"duration\": 622, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=32, train binary_classification_accuracy =0.701989010989011\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=32, train binary_classification_cross_entropy =0.6199243975628863\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=32, train binary_f_1.000 =0.7590343246581307\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831379.5540876, \"EndTime\": 1641831380.1803937, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 625.3211498260498, \"count\": 1, \"min\": 625.3211498260498, \"max\": 625.3211498260498}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #progress_metric: host=algo-1, completed 33.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831379.5550423, \"EndTime\": 1641831380.180618, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 32, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 2989810.0, \"count\": 1, \"min\": 2989810, \"max\": 2989810}, \"Total Batches Seen\": {\"sum\": 3004.0, \"count\": 1, \"min\": 3004, \"max\": 3004}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 34.0, \"count\": 1, \"min\": 34, \"max\": 34}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144755.56212330042 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=33, batch=0 train binary_classification_accuracy =0.708\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=33, batch=0 train binary_classification_cross_entropy =0.6026983032226563\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=33, batch=0 train binary_f_1.000 =0.792022792022792\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:20.810] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 68, \"duration\": 627, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=33, train binary_classification_accuracy =0.7036153846153846\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=33, train binary_classification_cross_entropy =0.6186228825495793\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=33, train binary_f_1.000 =0.7598500565404376\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831380.1804614, \"EndTime\": 1641831380.8110468, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 629.8089027404785, \"count\": 1, \"min\": 629.8089027404785, \"max\": 629.8089027404785}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #progress_metric: host=algo-1, completed 34.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831380.1812084, \"EndTime\": 1641831380.8113205, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 33, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 3080380.0, \"count\": 1, \"min\": 3080380, \"max\": 3080380}, \"Total Batches Seen\": {\"sum\": 3095.0, \"count\": 1, \"min\": 3095, \"max\": 3095}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 35.0, \"count\": 1, \"min\": 35, \"max\": 35}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=143706.40639895407 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=34, batch=0 train binary_classification_accuracy =0.706\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=34, batch=0 train binary_classification_cross_entropy =0.60149462890625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:20 INFO 139736811280192] #quality_metric: host=algo-1, epoch=34, batch=0 train binary_f_1.000 =0.79\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:21.438] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 70, \"duration\": 624, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:21 INFO 139736811280192] #quality_metric: host=algo-1, epoch=34, train binary_classification_accuracy =0.705032967032967\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:21 INFO 139736811280192] #quality_metric: host=algo-1, epoch=34, train binary_classification_cross_entropy =0.6173284254807693\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:21 INFO 139736811280192] #quality_metric: host=algo-1, epoch=34, train binary_f_1.000 =0.7604847057143876\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831380.8111317, \"EndTime\": 1641831381.4385457, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 626.5377998352051, \"count\": 1, \"min\": 626.5377998352051, \"max\": 626.5377998352051}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:21 INFO 139736811280192] #progress_metric: host=algo-1, completed 35.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831380.811979, \"EndTime\": 1641831381.4387434, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 34, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 3170950.0, \"count\": 1, \"min\": 3170950, \"max\": 3170950}, \"Total Batches Seen\": {\"sum\": 3186.0, \"count\": 1, \"min\": 3186, \"max\": 3186}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 36.0, \"count\": 1, \"min\": 36, \"max\": 36}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:21 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144480.12048944272 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:21 INFO 139736811280192] #quality_metric: host=algo-1, epoch=35, batch=0 train binary_classification_accuracy =0.708\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:21 INFO 139736811280192] #quality_metric: host=algo-1, epoch=35, batch=0 train binary_classification_cross_entropy =0.6002968139648438\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:21 INFO 139736811280192] #quality_metric: host=algo-1, epoch=35, batch=0 train binary_f_1.000 =0.7908309455587392\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:22.059] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 72, \"duration\": 618, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=35, train binary_classification_accuracy =0.7066263736263736\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=35, train binary_classification_cross_entropy =0.616041255741329\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=35, train binary_f_1.000 =0.7612822461662271\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831381.4386113, \"EndTime\": 1641831382.0603406, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 620.9630966186523, \"count\": 1, \"min\": 620.9630966186523, \"max\": 620.9630966186523}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #progress_metric: host=algo-1, completed 36.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831381.4393504, \"EndTime\": 1641831382.0605423, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 35, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 3261520.0, \"count\": 1, \"min\": 3261520, \"max\": 3261520}, \"Total Batches Seen\": {\"sum\": 3277.0, \"count\": 1, \"min\": 3277, \"max\": 3277}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 37.0, \"count\": 1, \"min\": 37, \"max\": 37}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=145774.9361953274 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=36, batch=0 train binary_classification_accuracy =0.71\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=36, batch=0 train binary_classification_cross_entropy =0.5991051025390625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=36, batch=0 train binary_f_1.000 =0.7916666666666666\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:22.686] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 74, \"duration\": 620, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=36, train binary_classification_accuracy =0.7083076923076923\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=36, train binary_classification_cross_entropy =0.6147616650927198\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=36, train binary_f_1.000 =0.7621292230486603\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831382.0604067, \"EndTime\": 1641831382.6871812, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 625.9233951568604, \"count\": 1, \"min\": 625.9233951568604, \"max\": 625.9233951568604}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #progress_metric: host=algo-1, completed 37.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831382.0612226, \"EndTime\": 1641831382.6874652, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 36, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 3352090.0, \"count\": 1, \"min\": 3352090, \"max\": 3352090}, \"Total Batches Seen\": {\"sum\": 3368.0, \"count\": 1, \"min\": 3368, \"max\": 3368}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 38.0, \"count\": 1, \"min\": 38, \"max\": 38}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144587.02336819252 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=37, batch=0 train binary_classification_accuracy =0.708\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=37, batch=0 train binary_classification_cross_entropy =0.597919677734375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:22 INFO 139736811280192] #quality_metric: host=algo-1, epoch=37, batch=0 train binary_f_1.000 =0.7899280575539568\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:23.327] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 76, \"duration\": 636, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=37, train binary_classification_accuracy =0.7092637362637363\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=37, train binary_classification_cross_entropy =0.6134899466378348\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=37, train binary_f_1.000 =0.7624426466494868\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831382.6872663, \"EndTime\": 1641831383.3281474, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 639.9035453796387, \"count\": 1, \"min\": 639.9035453796387, \"max\": 639.9035453796387}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #progress_metric: host=algo-1, completed 38.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831382.6882126, \"EndTime\": 1641831383.328429, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 37, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 3442660.0, \"count\": 1, \"min\": 3442660, \"max\": 3442660}, \"Total Batches Seen\": {\"sum\": 3459.0, \"count\": 1, \"min\": 3459, \"max\": 3459}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 39.0, \"count\": 1, \"min\": 39, \"max\": 39}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=141434.09300860568 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=38, batch=0 train binary_classification_accuracy =0.712\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=38, batch=0 train binary_classification_cross_entropy =0.596740966796875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=38, batch=0 train binary_f_1.000 =0.7922077922077922\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:23.969] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 78, \"duration\": 637, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=38, train binary_classification_accuracy =0.7102967032967032\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=38, train binary_classification_cross_entropy =0.6122264303689474\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=38, train binary_f_1.000 =0.762843751967831\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831383.3282428, \"EndTime\": 1641831383.9699757, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 640.737771987915, \"count\": 1, \"min\": 640.737771987915, \"max\": 640.737771987915}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #progress_metric: host=algo-1, completed 39.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831383.3292089, \"EndTime\": 1641831383.9701881, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 38, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 3533230.0, \"count\": 1, \"min\": 3533230, \"max\": 3533230}, \"Total Batches Seen\": {\"sum\": 3550.0, \"count\": 1, \"min\": 3550, \"max\": 3550}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 40.0, \"count\": 1, \"min\": 40, \"max\": 40}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=141275.0344486981 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=39, batch=0 train binary_classification_accuracy =0.714\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=39, batch=0 train binary_classification_cross_entropy =0.5955693359375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:23 INFO 139736811280192] #quality_metric: host=algo-1, epoch=39, batch=0 train binary_f_1.000 =0.7933526011560693\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:24.583] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 80, \"duration\": 610, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:24 INFO 139736811280192] #quality_metric: host=algo-1, epoch=39, train binary_classification_accuracy =0.7115604395604396\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:24 INFO 139736811280192] #quality_metric: host=algo-1, epoch=39, train binary_classification_cross_entropy =0.610971428839715\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:24 INFO 139736811280192] #quality_metric: host=algo-1, epoch=39, train binary_f_1.000 =0.7633567139688779\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831383.9700499, \"EndTime\": 1641831384.583873, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 613.0459308624268, \"count\": 1, \"min\": 613.0459308624268, \"max\": 613.0459308624268}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:24 INFO 139736811280192] #progress_metric: host=algo-1, completed 40.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831383.9707994, \"EndTime\": 1641831384.584072, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 39, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 3623800.0, \"count\": 1, \"min\": 3623800, \"max\": 3623800}, \"Total Batches Seen\": {\"sum\": 3641.0, \"count\": 1, \"min\": 3641, \"max\": 3641}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 41.0, \"count\": 1, \"min\": 41, \"max\": 41}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:24 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=147657.42641482738 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:24 INFO 139736811280192] #quality_metric: host=algo-1, epoch=40, batch=0 train binary_classification_accuracy =0.712\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:24 INFO 139736811280192] #quality_metric: host=algo-1, epoch=40, batch=0 train binary_classification_cross_entropy =0.5944051513671875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:24 INFO 139736811280192] #quality_metric: host=algo-1, epoch=40, batch=0 train binary_f_1.000 =0.7916063675832128\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:25.254] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 82, \"duration\": 668, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=40, train binary_classification_accuracy =0.7126263736263736\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=40, train binary_classification_cross_entropy =0.6097252626523867\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=40, train binary_f_1.000 =0.7637093057927408\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831384.583937, \"EndTime\": 1641831385.2551548, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 670.447587966919, \"count\": 1, \"min\": 670.447587966919, \"max\": 670.447587966919}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #progress_metric: host=algo-1, completed 41.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831384.5846753, \"EndTime\": 1641831385.2554202, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 40, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 3714370.0, \"count\": 1, \"min\": 3714370, \"max\": 3714370}, \"Total Batches Seen\": {\"sum\": 3732.0, \"count\": 1, \"min\": 3732, \"max\": 3732}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 42.0, \"count\": 1, \"min\": 42, \"max\": 42}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=134997.7907559388 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=41, batch=0 train binary_classification_accuracy =0.713\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=41, batch=0 train binary_classification_cross_entropy =0.5932486572265625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=41, batch=0 train binary_f_1.000 =0.7921795800144823\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:25.884] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 84, \"duration\": 625, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=41, train binary_classification_accuracy =0.7140659340659341\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=41, train binary_classification_cross_entropy =0.6084882289341518\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=41, train binary_f_1.000 =0.7643585517378784\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831385.2552376, \"EndTime\": 1641831385.8846815, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 628.4806728363037, \"count\": 1, \"min\": 628.4806728363037, \"max\": 628.4806728363037}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #progress_metric: host=algo-1, completed 42.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831385.2561712, \"EndTime\": 1641831385.8849204, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 41, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 3804940.0, \"count\": 1, \"min\": 3804940, \"max\": 3804940}, \"Total Batches Seen\": {\"sum\": 3823.0, \"count\": 1, \"min\": 3823, \"max\": 3823}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 43.0, \"count\": 1, \"min\": 43, \"max\": 43}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144020.87959782535 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=42, batch=0 train binary_classification_accuracy =0.714\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=42, batch=0 train binary_classification_cross_entropy =0.5921002197265625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:25 INFO 139736811280192] #quality_metric: host=algo-1, epoch=42, batch=0 train binary_f_1.000 =0.7924528301886793\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:26.513] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 86, \"duration\": 624, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:26 INFO 139736811280192] #quality_metric: host=algo-1, epoch=42, train binary_classification_accuracy =0.715076923076923\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:26 INFO 139736811280192] #quality_metric: host=algo-1, epoch=42, train binary_classification_cross_entropy =0.6072606362143715\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:26 INFO 139736811280192] #quality_metric: host=algo-1, epoch=42, train binary_f_1.000 =0.7646973409565296\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831385.8847775, \"EndTime\": 1641831386.5141373, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 628.5412311553955, \"count\": 1, \"min\": 628.5412311553955, \"max\": 628.5412311553955}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:26 INFO 139736811280192] #progress_metric: host=algo-1, completed 43.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831385.8855672, \"EndTime\": 1641831386.5143232, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 42, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 3895510.0, \"count\": 1, \"min\": 3895510, \"max\": 3895510}, \"Total Batches Seen\": {\"sum\": 3914.0, \"count\": 1, \"min\": 3914, \"max\": 3914}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 44.0, \"count\": 1, \"min\": 44, \"max\": 44}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:26 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144026.88604197078 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:26 INFO 139736811280192] #quality_metric: host=algo-1, epoch=43, batch=0 train binary_classification_accuracy =0.715\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:26 INFO 139736811280192] #quality_metric: host=algo-1, epoch=43, batch=0 train binary_classification_cross_entropy =0.590960205078125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:26 INFO 139736811280192] #quality_metric: host=algo-1, epoch=43, batch=0 train binary_f_1.000 =0.7930283224400871\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:27.147] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 88, \"duration\": 630, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=43, train binary_classification_accuracy =0.7164945054945054\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=43, train binary_classification_cross_entropy =0.6060427494258671\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=43, train binary_f_1.000 =0.7653292340158454\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831386.5142071, \"EndTime\": 1641831387.147976, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 633.1331729888916, \"count\": 1, \"min\": 633.1331729888916, \"max\": 633.1331729888916}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #progress_metric: host=algo-1, completed 44.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831386.5148122, \"EndTime\": 1641831387.1482785, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 43, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 3986080.0, \"count\": 1, \"min\": 3986080, \"max\": 3986080}, \"Total Batches Seen\": {\"sum\": 4005.0, \"count\": 1, \"min\": 4005, \"max\": 4005}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 45.0, \"count\": 1, \"min\": 45, \"max\": 45}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=142927.11323647542 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=44, batch=0 train binary_classification_accuracy =0.713\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=44, batch=0 train binary_classification_cross_entropy =0.5898289794921875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=44, batch=0 train binary_f_1.000 =0.7909686817188638\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:27.778] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 90, \"duration\": 627, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=44, train binary_classification_accuracy =0.7177362637362638\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=44, train binary_classification_cross_entropy =0.6048348261235834\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=44, train binary_f_1.000 =0.7657711878317011\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831387.148063, \"EndTime\": 1641831387.779302, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 630.1941871643066, \"count\": 1, \"min\": 630.1941871643066, \"max\": 630.1941871643066}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #progress_metric: host=algo-1, completed 45.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831387.1490765, \"EndTime\": 1641831387.7795968, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 44, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 4076650.0, \"count\": 1, \"min\": 4076650, \"max\": 4076650}, \"Total Batches Seen\": {\"sum\": 4096.0, \"count\": 1, \"min\": 4096, \"max\": 4096}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 46.0, \"count\": 1, \"min\": 46, \"max\": 46}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=143611.60454669007 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=45, batch=0 train binary_classification_accuracy =0.713\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=45, batch=0 train binary_classification_cross_entropy =0.5887067260742187\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:27 INFO 139736811280192] #quality_metric: host=algo-1, epoch=45, batch=0 train binary_f_1.000 =0.7909686817188638\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:28.408] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 92, \"duration\": 622, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:28 INFO 139736811280192] #quality_metric: host=algo-1, epoch=45, train binary_classification_accuracy =0.7188461538461538\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:28 INFO 139736811280192] #quality_metric: host=algo-1, epoch=45, train binary_classification_cross_entropy =0.6036371198381696\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:28 INFO 139736811280192] #quality_metric: host=algo-1, epoch=45, train binary_f_1.000 =0.7662381565843452\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831387.7793968, \"EndTime\": 1641831388.4093804, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 628.9184093475342, \"count\": 1, \"min\": 628.9184093475342, \"max\": 628.9184093475342}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:28 INFO 139736811280192] #progress_metric: host=algo-1, completed 46.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831387.7803557, \"EndTime\": 1641831388.4097383, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 45, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 4167220.0, \"count\": 1, \"min\": 4167220, \"max\": 4167220}, \"Total Batches Seen\": {\"sum\": 4187.0, \"count\": 1, \"min\": 4187, \"max\": 4187}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 47.0, \"count\": 1, \"min\": 47, \"max\": 47}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:28 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=143865.16012217314 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:28 INFO 139736811280192] #quality_metric: host=algo-1, epoch=46, batch=0 train binary_classification_accuracy =0.715\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:28 INFO 139736811280192] #quality_metric: host=algo-1, epoch=46, batch=0 train binary_classification_cross_entropy =0.5875938110351563\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:28 INFO 139736811280192] #quality_metric: host=algo-1, epoch=46, batch=0 train binary_f_1.000 =0.7921225382932167\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:29.035] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 94, \"duration\": 622, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=46, train binary_classification_accuracy =0.7195274725274725\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=46, train binary_classification_cross_entropy =0.6024498378208706\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=46, train binary_f_1.000 =0.7663392260438886\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831388.4094718, \"EndTime\": 1641831389.036485, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 625.943660736084, \"count\": 1, \"min\": 625.943660736084, \"max\": 625.943660736084}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #progress_metric: host=algo-1, completed 47.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831388.410506, \"EndTime\": 1641831389.0367787, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 46, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 4257790.0, \"count\": 1, \"min\": 4257790, \"max\": 4257790}, \"Total Batches Seen\": {\"sum\": 4278.0, \"count\": 1, \"min\": 4278, \"max\": 4278}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 48.0, \"count\": 1, \"min\": 48, \"max\": 48}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144580.75000589926 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=47, batch=0 train binary_classification_accuracy =0.716\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=47, batch=0 train binary_classification_cross_entropy =0.586490478515625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=47, batch=0 train binary_f_1.000 =0.7927007299270074\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:29.663] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 96, \"duration\": 624, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=47, train binary_classification_accuracy =0.7204835164835165\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=47, train binary_classification_cross_entropy =0.601273186652215\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=47, train binary_f_1.000 =0.7666336379316672\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831389.0365684, \"EndTime\": 1641831389.664381, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 626.8320083618164, \"count\": 1, \"min\": 626.8320083618164, \"max\": 626.8320083618164}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #progress_metric: host=algo-1, completed 48.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831389.0375168, \"EndTime\": 1641831389.66466, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 47, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 4348360.0, \"count\": 1, \"min\": 4348360, \"max\": 4348360}, \"Total Batches Seen\": {\"sum\": 4369.0, \"count\": 1, \"min\": 4369, \"max\": 4369}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 49.0, \"count\": 1, \"min\": 49, \"max\": 49}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144377.10678820533 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=48, batch=0 train binary_classification_accuracy =0.718\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=48, batch=0 train binary_classification_cross_entropy =0.5853969116210938\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:29 INFO 139736811280192] #quality_metric: host=algo-1, epoch=48, batch=0 train binary_f_1.000 =0.7935578330893118\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:30.276] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 98, \"duration\": 609, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=48, train binary_classification_accuracy =0.7212857142857143\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=48, train binary_classification_cross_entropy =0.6001073407183637\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=48, train binary_f_1.000 =0.7668691919516881\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831389.664467, \"EndTime\": 1641831390.277609, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 612.2376918792725, \"count\": 1, \"min\": 612.2376918792725, \"max\": 612.2376918792725}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #progress_metric: host=algo-1, completed 49.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831389.6653407, \"EndTime\": 1641831390.2778833, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 48, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 4438930.0, \"count\": 1, \"min\": 4438930, \"max\": 4438930}, \"Total Batches Seen\": {\"sum\": 4460.0, \"count\": 1, \"min\": 4460, \"max\": 4460}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 50.0, \"count\": 1, \"min\": 50, \"max\": 50}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=147827.73837769264 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=49, batch=0 train binary_classification_accuracy =0.72\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=49, batch=0 train binary_classification_cross_entropy =0.5843134155273437\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=49, batch=0 train binary_f_1.000 =0.7947214076246334\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:30.902] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 100, \"duration\": 622, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=49, train binary_classification_accuracy =0.7222747252747252\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=49, train binary_classification_cross_entropy =0.5989524744054774\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=49, train binary_f_1.000 =0.7672428877980494\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831390.2776947, \"EndTime\": 1641831390.9033506, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 624.7425079345703, \"count\": 1, \"min\": 624.7425079345703, \"max\": 624.7425079345703}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #progress_metric: host=algo-1, completed 50.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831390.2785783, \"EndTime\": 1641831390.9036186, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 49, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 4529500.0, \"count\": 1, \"min\": 4529500, \"max\": 4529500}, \"Total Batches Seen\": {\"sum\": 4551.0, \"count\": 1, \"min\": 4551, \"max\": 4551}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 51.0, \"count\": 1, \"min\": 51, \"max\": 51}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144881.93416893468 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=50, batch=0 train binary_classification_accuracy =0.723\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=50, batch=0 train binary_classification_cross_entropy =0.5832401733398438\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:30 INFO 139736811280192] #quality_metric: host=algo-1, epoch=50, batch=0 train binary_f_1.000 =0.7964731814842028\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:31.519] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 102, \"duration\": 613, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:31 INFO 139736811280192] #quality_metric: host=algo-1, epoch=50, train binary_classification_accuracy =0.7228461538461538\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:31 INFO 139736811280192] #quality_metric: host=algo-1, epoch=50, train binary_classification_cross_entropy =0.5978087225274725\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:31 INFO 139736811280192] #quality_metric: host=algo-1, epoch=50, train binary_f_1.000 =0.7672759820250431\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831390.9034421, \"EndTime\": 1641831391.520382, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 616.2610054016113, \"count\": 1, \"min\": 616.2610054016113, \"max\": 616.2610054016113}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:31 INFO 139736811280192] #progress_metric: host=algo-1, completed 51.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831390.904094, \"EndTime\": 1641831391.5206733, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 50, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 4620070.0, \"count\": 1, \"min\": 4620070, \"max\": 4620070}, \"Total Batches Seen\": {\"sum\": 4642.0, \"count\": 1, \"min\": 4642, \"max\": 4642}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 52.0, \"count\": 1, \"min\": 52, \"max\": 52}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:31 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=146836.51823946825 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:31 INFO 139736811280192] #quality_metric: host=algo-1, epoch=51, batch=0 train binary_classification_accuracy =0.725\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:31 INFO 139736811280192] #quality_metric: host=algo-1, epoch=51, batch=0 train binary_classification_cross_entropy =0.5821773071289063\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:31 INFO 139736811280192] #quality_metric: host=algo-1, epoch=51, batch=0 train binary_f_1.000 =0.7973470891672808\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:32.129] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 104, \"duration\": 606, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=51, train binary_classification_accuracy =0.7238021978021978\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=51, train binary_classification_cross_entropy =0.5966762017889338\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=51, train binary_f_1.000 =0.7677251219872837\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831391.5205019, \"EndTime\": 1641831392.1301506, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 608.673095703125, \"count\": 1, \"min\": 608.673095703125, \"max\": 608.673095703125}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #progress_metric: host=algo-1, completed 52.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831391.5214396, \"EndTime\": 1641831392.1303494, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 51, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 4710640.0, \"count\": 1, \"min\": 4710640, \"max\": 4710640}, \"Total Batches Seen\": {\"sum\": 4733.0, \"count\": 1, \"min\": 4733, \"max\": 4733}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 53.0, \"count\": 1, \"min\": 53, \"max\": 53}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=148715.318944033 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=52, batch=0 train binary_classification_accuracy =0.728\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=52, batch=0 train binary_classification_cross_entropy =0.5811251220703125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=52, batch=0 train binary_f_1.000 =0.7991137370753324\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:32.743] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 106, \"duration\": 609, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=52, train binary_classification_accuracy =0.7244285714285714\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=52, train binary_classification_cross_entropy =0.5955550114558293\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=52, train binary_f_1.000 =0.7677991055307092\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831392.130215, \"EndTime\": 1641831392.7442057, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 613.2016181945801, \"count\": 1, \"min\": 613.2016181945801, \"max\": 613.2016181945801}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #progress_metric: host=algo-1, completed 53.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831392.130971, \"EndTime\": 1641831392.7444367, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 52, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 4801210.0, \"count\": 1, \"min\": 4801210, \"max\": 4801210}, \"Total Batches Seen\": {\"sum\": 4824.0, \"count\": 1, \"min\": 4824, \"max\": 4824}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 54.0, \"count\": 1, \"min\": 54, \"max\": 54}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=147604.9295970569 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=53, batch=0 train binary_classification_accuracy =0.73\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=53, batch=0 train binary_classification_cross_entropy =0.5800836181640625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:32 INFO 139736811280192] #quality_metric: host=algo-1, epoch=53, batch=0 train binary_f_1.000 =0.8002958579881657\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:33.383] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 108, \"duration\": 636, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:33 INFO 139736811280192] #quality_metric: host=algo-1, epoch=53, train binary_classification_accuracy =0.724978021978022\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:33 INFO 139736811280192] #quality_metric: host=algo-1, epoch=53, train binary_classification_cross_entropy =0.5944452494526957\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:33 INFO 139736811280192] #quality_metric: host=algo-1, epoch=53, train binary_f_1.000 =0.7679827936254833\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831392.7442818, \"EndTime\": 1641831393.3838623, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 638.7825012207031, \"count\": 1, \"min\": 638.7825012207031, \"max\": 638.7825012207031}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:33 INFO 139736811280192] #progress_metric: host=algo-1, completed 54.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831392.7450538, \"EndTime\": 1641831393.3840637, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 53, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 4891780.0, \"count\": 1, \"min\": 4891780, \"max\": 4891780}, \"Total Batches Seen\": {\"sum\": 4915.0, \"count\": 1, \"min\": 4915, \"max\": 4915}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 55.0, \"count\": 1, \"min\": 55, \"max\": 55}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:33 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=141712.145971547 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:33 INFO 139736811280192] #quality_metric: host=algo-1, epoch=54, batch=0 train binary_classification_accuracy =0.73\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:33 INFO 139736811280192] #quality_metric: host=algo-1, epoch=54, batch=0 train binary_classification_cross_entropy =0.579052978515625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:33 INFO 139736811280192] #quality_metric: host=algo-1, epoch=54, batch=0 train binary_f_1.000 =0.7997032640949555\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:34.024] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 110, \"duration\": 637, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=54, train binary_classification_accuracy =0.7257362637362638\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=54, train binary_classification_cross_entropy =0.5933469794975532\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=54, train binary_f_1.000 =0.7682679987372565\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831393.3839293, \"EndTime\": 1641831394.024876, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 640.1674747467041, \"count\": 1, \"min\": 640.1674747467041, \"max\": 640.1674747467041}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #progress_metric: host=algo-1, completed 55.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831393.3846765, \"EndTime\": 1641831394.0251534, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 54, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 4982350.0, \"count\": 1, \"min\": 4982350, \"max\": 4982350}, \"Total Batches Seen\": {\"sum\": 5006.0, \"count\": 1, \"min\": 5006, \"max\": 5006}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 56.0, \"count\": 1, \"min\": 56, \"max\": 56}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=141380.34967135268 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=55, batch=0 train binary_classification_accuracy =0.732\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=55, batch=0 train binary_classification_cross_entropy =0.5780333251953125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=55, batch=0 train binary_f_1.000 =0.8008915304606241\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:34.651] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 112, \"duration\": 624, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=55, train binary_classification_accuracy =0.7262967032967033\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=55, train binary_classification_cross_entropy =0.5922602398212139\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=55, train binary_f_1.000 =0.76835653767101\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831394.0249615, \"EndTime\": 1641831394.6523798, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 626.4567375183105, \"count\": 1, \"min\": 626.4567375183105, \"max\": 626.4567375183105}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #progress_metric: host=algo-1, completed 56.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831394.0258944, \"EndTime\": 1641831394.652579, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 55, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 5072920.0, \"count\": 1, \"min\": 5072920, \"max\": 5072920}, \"Total Batches Seen\": {\"sum\": 5097.0, \"count\": 1, \"min\": 5097, \"max\": 5097}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 57.0, \"count\": 1, \"min\": 57, \"max\": 57}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144494.24415723127 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=56, batch=0 train binary_classification_accuracy =0.735\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=56, batch=0 train binary_classification_cross_entropy =0.5770248413085938\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:34 INFO 139736811280192] #quality_metric: host=algo-1, epoch=56, batch=0 train binary_f_1.000 =0.8023862788963461\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:35.287] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 114, \"duration\": 632, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=56, train binary_classification_accuracy =0.7268021978021978\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=56, train binary_classification_cross_entropy =0.5911850693252061\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=56, train binary_f_1.000 =0.7685087760137809\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831394.652445, \"EndTime\": 1641831395.2890835, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 635.8022689819336, \"count\": 1, \"min\": 635.8022689819336, \"max\": 635.8022689819336}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #progress_metric: host=algo-1, completed 57.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831394.6532202, \"EndTime\": 1641831395.2895732, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 56, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 5163490.0, \"count\": 1, \"min\": 5163490, \"max\": 5163490}, \"Total Batches Seen\": {\"sum\": 5188.0, \"count\": 1, \"min\": 5188, \"max\": 5188}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 58.0, \"count\": 1, \"min\": 58, \"max\": 58}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=142295.89935702822 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=57, batch=0 train binary_classification_accuracy =0.735\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=57, batch=0 train binary_classification_cross_entropy =0.5760274658203125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=57, batch=0 train binary_f_1.000 =0.8023862788963461\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:35.915] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 116, \"duration\": 622, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=57, train binary_classification_accuracy =0.7273406593406594\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=57, train binary_classification_cross_entropy =0.5901214733752576\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=57, train binary_f_1.000 =0.7686871888576063\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831395.2893822, \"EndTime\": 1641831395.916722, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 626.4297962188721, \"count\": 1, \"min\": 626.4297962188721, \"max\": 626.4297962188721}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #progress_metric: host=algo-1, completed 58.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831395.2902603, \"EndTime\": 1641831395.9170122, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 57, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 5254060.0, \"count\": 1, \"min\": 5254060, \"max\": 5254060}, \"Total Batches Seen\": {\"sum\": 5279.0, \"count\": 1, \"min\": 5279, \"max\": 5279}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 59.0, \"count\": 1, \"min\": 59, \"max\": 59}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144471.82343529598 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=58, batch=0 train binary_classification_accuracy =0.736\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=58, batch=0 train binary_classification_cross_entropy =0.57504150390625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:35 INFO 139736811280192] #quality_metric: host=algo-1, epoch=58, batch=0 train binary_f_1.000 =0.8029850746268656\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:36.553] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 118, \"duration\": 633, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:36 INFO 139736811280192] #quality_metric: host=algo-1, epoch=58, train binary_classification_accuracy =0.7278131868131869\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:36 INFO 139736811280192] #quality_metric: host=algo-1, epoch=58, train binary_classification_cross_entropy =0.5890694573370965\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:36 INFO 139736811280192] #quality_metric: host=algo-1, epoch=58, train binary_f_1.000 =0.7688272901208643\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831395.9168198, \"EndTime\": 1641831396.553976, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 636.1877918243408, \"count\": 1, \"min\": 636.1877918243408, \"max\": 636.1877918243408}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:36 INFO 139736811280192] #progress_metric: host=algo-1, completed 59.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831395.9177582, \"EndTime\": 1641831396.5541875, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 58, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 5344630.0, \"count\": 1, \"min\": 5344630, \"max\": 5344630}, \"Total Batches Seen\": {\"sum\": 5370.0, \"count\": 1, \"min\": 5370, \"max\": 5370}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 60.0, \"count\": 1, \"min\": 60, \"max\": 60}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:36 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=142283.21469972542 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:36 INFO 139736811280192] #quality_metric: host=algo-1, epoch=59, batch=0 train binary_classification_accuracy =0.737\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:36 INFO 139736811280192] #quality_metric: host=algo-1, epoch=59, batch=0 train binary_classification_cross_entropy =0.5740667724609375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:36 INFO 139736811280192] #quality_metric: host=algo-1, epoch=59, batch=0 train binary_f_1.000 =0.8035847647498133\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:37.156] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 120, \"duration\": 599, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=59, train binary_classification_accuracy =0.7282197802197802\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=59, train binary_classification_cross_entropy =0.5880290044428228\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=59, train binary_f_1.000 =0.7688554926260304\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831396.5540426, \"EndTime\": 1641831397.1572807, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 602.4343967437744, \"count\": 1, \"min\": 602.4343967437744, \"max\": 602.4343967437744}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #progress_metric: host=algo-1, completed 60.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831396.5548124, \"EndTime\": 1641831397.1576025, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 59, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 5435200.0, \"count\": 1, \"min\": 5435200, \"max\": 5435200}, \"Total Batches Seen\": {\"sum\": 5461.0, \"count\": 1, \"min\": 5461, \"max\": 5461}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 61.0, \"count\": 1, \"min\": 61, \"max\": 61}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=150215.23785120124 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=60, batch=0 train binary_classification_accuracy =0.738\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=60, batch=0 train binary_classification_cross_entropy =0.5731033935546875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=60, batch=0 train binary_f_1.000 =0.804185351270553\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:37.824] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 122, \"duration\": 664, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=60, train binary_classification_accuracy =0.7288461538461538\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=60, train binary_classification_cross_entropy =0.5870000851809324\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=60, train binary_f_1.000 =0.7691228070175439\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831397.1574104, \"EndTime\": 1641831397.8250687, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 666.8386459350586, \"count\": 1, \"min\": 666.8386459350586, \"max\": 666.8386459350586}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #progress_metric: host=algo-1, completed 61.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831397.1582046, \"EndTime\": 1641831397.825269, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 60, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 5525770.0, \"count\": 1, \"min\": 5525770, \"max\": 5525770}, \"Total Batches Seen\": {\"sum\": 5552.0, \"count\": 1, \"min\": 5552, \"max\": 5552}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 62.0, \"count\": 1, \"min\": 62, \"max\": 62}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=135753.17631419076 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=61, batch=0 train binary_classification_accuracy =0.738\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=61, batch=0 train binary_classification_cross_entropy =0.5721514892578125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:37 INFO 139736811280192] #quality_metric: host=algo-1, epoch=61, batch=0 train binary_f_1.000 =0.8038922155688623\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:38.457] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 124, \"duration\": 629, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:38 INFO 139736811280192] #quality_metric: host=algo-1, epoch=61, train binary_classification_accuracy =0.7291318681318681\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:38 INFO 139736811280192] #quality_metric: host=algo-1, epoch=61, train binary_classification_cross_entropy =0.5859826593084649\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:38 INFO 139736811280192] #quality_metric: host=algo-1, epoch=61, train binary_f_1.000 =0.7691241347657897\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831397.8251338, \"EndTime\": 1641831398.4583333, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 632.4183940887451, \"count\": 1, \"min\": 632.4183940887451, \"max\": 632.4183940887451}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:38 INFO 139736811280192] #progress_metric: host=algo-1, completed 62.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831397.8258877, \"EndTime\": 1641831398.4585404, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 61, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 5616340.0, \"count\": 1, \"min\": 5616340, \"max\": 5616340}, \"Total Batches Seen\": {\"sum\": 5643.0, \"count\": 1, \"min\": 5643, \"max\": 5643}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 63.0, \"count\": 1, \"min\": 63, \"max\": 63}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:38 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=143133.5326592344 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:38 INFO 139736811280192] #quality_metric: host=algo-1, epoch=62, batch=0 train binary_classification_accuracy =0.74\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:38 INFO 139736811280192] #quality_metric: host=algo-1, epoch=62, batch=0 train binary_classification_cross_entropy =0.5712109375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:38 INFO 139736811280192] #quality_metric: host=algo-1, epoch=62, batch=0 train binary_f_1.000 =0.8050974512743628\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:39.080] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 126, \"duration\": 618, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=62, train binary_classification_accuracy =0.7295054945054945\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=62, train binary_classification_cross_entropy =0.5849766617659684\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=62, train binary_f_1.000 =0.7692004763199595\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831398.4583988, \"EndTime\": 1641831399.0814254, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 622.1890449523926, \"count\": 1, \"min\": 622.1890449523926, \"max\": 622.1890449523926}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #progress_metric: host=algo-1, completed 63.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831398.4592087, \"EndTime\": 1641831399.0816305, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 62, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 5706910.0, \"count\": 1, \"min\": 5706910, \"max\": 5706910}, \"Total Batches Seen\": {\"sum\": 5734.0, \"count\": 1, \"min\": 5734, \"max\": 5734}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 64.0, \"count\": 1, \"min\": 64, \"max\": 64}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=145486.29970908724 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=63, batch=0 train binary_classification_accuracy =0.742\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=63, batch=0 train binary_classification_cross_entropy =0.5702819213867187\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=63, batch=0 train binary_f_1.000 =0.8057228915662651\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:39.689] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 128, \"duration\": 605, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=63, train binary_classification_accuracy =0.7298021978021978\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=63, train binary_classification_cross_entropy =0.5839820670662346\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=63, train binary_f_1.000 =0.769226437407317\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831399.0814922, \"EndTime\": 1641831399.6903265, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 608.0312728881836, \"count\": 1, \"min\": 608.0312728881836, \"max\": 608.0312728881836}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #progress_metric: host=algo-1, completed 64.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831399.0822632, \"EndTime\": 1641831399.6905808, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 63, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 5797480.0, \"count\": 1, \"min\": 5797480, \"max\": 5797480}, \"Total Batches Seen\": {\"sum\": 5825.0, \"count\": 1, \"min\": 5825, \"max\": 5825}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 65.0, \"count\": 1, \"min\": 65, \"max\": 65}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=148856.8099468254 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=64, batch=0 train binary_classification_accuracy =0.743\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=64, batch=0 train binary_classification_cross_entropy =0.5693642578125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:39 INFO 139736811280192] #quality_metric: host=algo-1, epoch=64, batch=0 train binary_f_1.000 =0.8060377358490566\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:40.350] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 130, \"duration\": 657, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=64, train binary_classification_accuracy =0.7301318681318681\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=64, train binary_classification_cross_entropy =0.5829987672239869\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=64, train binary_f_1.000 =0.7692784667418264\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831399.6904123, \"EndTime\": 1641831400.351438, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 660.1619720458984, \"count\": 1, \"min\": 660.1619720458984, \"max\": 660.1619720458984}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #progress_metric: host=algo-1, completed 65.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831399.6912434, \"EndTime\": 1641831400.351857, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 64, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 5888050.0, \"count\": 1, \"min\": 5888050, \"max\": 5888050}, \"Total Batches Seen\": {\"sum\": 5916.0, \"count\": 1, \"min\": 5916, \"max\": 5916}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 66.0, \"count\": 1, \"min\": 66, \"max\": 66}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=137075.3363410576 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=65, batch=0 train binary_classification_accuracy =0.747\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=65, batch=0 train binary_classification_cross_entropy =0.5684581298828125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=65, batch=0 train binary_f_1.000 =0.8084784254352763\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:40.971] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 132, \"duration\": 617, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=65, train binary_classification_accuracy =0.7304505494505494\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=65, train binary_classification_cross_entropy =0.5820267018747853\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=65, train binary_f_1.000 =0.7693537315818673\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831400.3515844, \"EndTime\": 1641831400.9723692, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 619.8544502258301, \"count\": 1, \"min\": 619.8544502258301, \"max\": 619.8544502258301}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #progress_metric: host=algo-1, completed 66.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831400.3524868, \"EndTime\": 1641831400.9726155, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 65, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 5978620.0, \"count\": 1, \"min\": 5978620, \"max\": 5978620}, \"Total Batches Seen\": {\"sum\": 6007.0, \"count\": 1, \"min\": 6007, \"max\": 6007}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 67.0, \"count\": 1, \"min\": 67, \"max\": 67}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=146019.69179959362 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=66, batch=0 train binary_classification_accuracy =0.747\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=66, batch=0 train binary_classification_cross_entropy =0.567563232421875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:40 INFO 139736811280192] #quality_metric: host=algo-1, epoch=66, batch=0 train binary_f_1.000 =0.8084784254352763\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:41.594] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 134, \"duration\": 618, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:41 INFO 139736811280192] #quality_metric: host=algo-1, epoch=66, train binary_classification_accuracy =0.7307582417582418\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:41 INFO 139736811280192] #quality_metric: host=algo-1, epoch=66, train binary_classification_cross_entropy =0.5810657885205615\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:41 INFO 139736811280192] #quality_metric: host=algo-1, epoch=66, train binary_f_1.000 =0.7694262241085629\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831400.9724486, \"EndTime\": 1641831401.594995, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 621.5791702270508, \"count\": 1, \"min\": 621.5791702270508, \"max\": 621.5791702270508}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:41 INFO 139736811280192] #progress_metric: host=algo-1, completed 67.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831400.9733803, \"EndTime\": 1641831401.5954883, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 66, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 6069190.0, \"count\": 1, \"min\": 6069190, \"max\": 6069190}, \"Total Batches Seen\": {\"sum\": 6098.0, \"count\": 1, \"min\": 6098, \"max\": 6098}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 68.0, \"count\": 1, \"min\": 68, \"max\": 68}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:41 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=145530.7209644887 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:41 INFO 139736811280192] #quality_metric: host=algo-1, epoch=67, batch=0 train binary_classification_accuracy =0.75\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:41 INFO 139736811280192] #quality_metric: host=algo-1, epoch=67, batch=0 train binary_classification_cross_entropy =0.5666798095703125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:41 INFO 139736811280192] #quality_metric: host=algo-1, epoch=67, batch=0 train binary_f_1.000 =0.8100303951367781\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:42.212] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 136, \"duration\": 613, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=67, train binary_classification_accuracy =0.7311538461538462\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=67, train binary_classification_cross_entropy =0.5801159265539149\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=67, train binary_f_1.000 =0.7695481391471445\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831401.5951972, \"EndTime\": 1641831402.2130616, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 616.7910099029541, \"count\": 1, \"min\": 616.7910099029541, \"max\": 616.7910099029541}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #progress_metric: host=algo-1, completed 68.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831401.596236, \"EndTime\": 1641831402.2133315, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 67, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 6159760.0, \"count\": 1, \"min\": 6159760, \"max\": 6159760}, \"Total Batches Seen\": {\"sum\": 6189.0, \"count\": 1, \"min\": 6189, \"max\": 6189}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 69.0, \"count\": 1, \"min\": 69, \"max\": 69}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=146734.7090186208 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=68, batch=0 train binary_classification_accuracy =0.749\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=68, batch=0 train binary_classification_cross_entropy =0.5658076782226562\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=68, batch=0 train binary_f_1.000 =0.8091254752851711\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:42.841] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 138, \"duration\": 625, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=68, train binary_classification_accuracy =0.7315054945054945\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=68, train binary_classification_cross_entropy =0.5791770321353451\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=68, train binary_f_1.000 =0.769680344635804\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831402.2131453, \"EndTime\": 1641831402.8422909, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 628.204345703125, \"count\": 1, \"min\": 628.204345703125, \"max\": 628.204345703125}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #progress_metric: host=algo-1, completed 69.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831402.2140567, \"EndTime\": 1641831402.8425515, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 68, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 6250330.0, \"count\": 1, \"min\": 6250330, \"max\": 6250330}, \"Total Batches Seen\": {\"sum\": 6280.0, \"count\": 1, \"min\": 6280, \"max\": 6280}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144078.39821406832 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=69, batch=0 train binary_classification_accuracy =0.749\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=69, batch=0 train binary_classification_cross_entropy =0.5649468383789062\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:42 INFO 139736811280192] #quality_metric: host=algo-1, epoch=69, batch=0 train binary_f_1.000 =0.8091254752851711\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:43.464] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 140, \"duration\": 618, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:43 INFO 139736811280192] #quality_metric: host=algo-1, epoch=69, train binary_classification_accuracy =0.731934065934066\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:43 INFO 139736811280192] #quality_metric: host=algo-1, epoch=69, train binary_classification_cross_entropy =0.5782489966088599\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:43 INFO 139736811280192] #quality_metric: host=algo-1, epoch=69, train binary_f_1.000 =0.7698635823317421\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831402.8423736, \"EndTime\": 1641831403.4650288, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 621.7050552368164, \"count\": 1, \"min\": 621.7050552368164, \"max\": 621.7050552368164}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:43 INFO 139736811280192] #progress_metric: host=algo-1, completed 70.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831402.843288, \"EndTime\": 1641831403.4654849, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 69, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 6340900.0, \"count\": 1, \"min\": 6340900, \"max\": 6340900}, \"Total Batches Seen\": {\"sum\": 6371.0, \"count\": 1, \"min\": 6371, \"max\": 6371}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 71.0, \"count\": 1, \"min\": 71, \"max\": 71}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:43 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=145525.59190648742 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:43 INFO 139736811280192] #quality_metric: host=algo-1, epoch=70, batch=0 train binary_classification_accuracy =0.748\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:43 INFO 139736811280192] #quality_metric: host=algo-1, epoch=70, batch=0 train binary_classification_cross_entropy =0.5640972290039062\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:43 INFO 139736811280192] #quality_metric: host=algo-1, epoch=70, batch=0 train binary_f_1.000 =0.8082191780821918\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:44.101] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 142, \"duration\": 633, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=70, train binary_classification_accuracy =0.7321978021978022\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=70, train binary_classification_cross_entropy =0.5773317173549107\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=70, train binary_f_1.000 =0.7699467582977759\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831403.4651673, \"EndTime\": 1641831404.1023908, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 636.0983848571777, \"count\": 1, \"min\": 636.0983848571777, \"max\": 636.0983848571777}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #progress_metric: host=algo-1, completed 71.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831403.466262, \"EndTime\": 1641831404.1026642, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 70, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 6431470.0, \"count\": 1, \"min\": 6431470, \"max\": 6431470}, \"Total Batches Seen\": {\"sum\": 6462.0, \"count\": 1, \"min\": 6462, \"max\": 6462}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 72.0, \"count\": 1, \"min\": 72, \"max\": 72}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=142285.07994867105 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=71, batch=0 train binary_classification_accuracy =0.749\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=71, batch=0 train binary_classification_cross_entropy =0.5632587890625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=71, batch=0 train binary_f_1.000 =0.8088347296268088\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:44.713] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 144, \"duration\": 608, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=71, train binary_classification_accuracy =0.7327032967032967\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=71, train binary_classification_cross_entropy =0.5764250957782452\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=71, train binary_f_1.000 =0.7702248252408842\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831404.1024783, \"EndTime\": 1641831404.714497, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 611.0670566558838, \"count\": 1, \"min\": 611.0670566558838, \"max\": 611.0670566558838}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #progress_metric: host=algo-1, completed 72.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831404.1034036, \"EndTime\": 1641831404.7146993, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 71, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 6522040.0, \"count\": 1, \"min\": 6522040, \"max\": 6522040}, \"Total Batches Seen\": {\"sum\": 6553.0, \"count\": 1, \"min\": 6553, \"max\": 6553}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 73.0, \"count\": 1, \"min\": 73, \"max\": 73}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=148136.03144923135 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=72, batch=0 train binary_classification_accuracy =0.748\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=72, batch=0 train binary_classification_cross_entropy =0.562431396484375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:44 INFO 139736811280192] #quality_metric: host=algo-1, epoch=72, batch=0 train binary_f_1.000 =0.8076335877862595\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:45.344] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 146, \"duration\": 625, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=72, train binary_classification_accuracy =0.732934065934066\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=72, train binary_classification_cross_entropy =0.5755290031013908\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=72, train binary_f_1.000 =0.7703038608761401\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831404.7145631, \"EndTime\": 1641831405.344722, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 629.3725967407227, \"count\": 1, \"min\": 629.3725967407227, \"max\": 629.3725967407227}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #progress_metric: host=algo-1, completed 73.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831404.7153158, \"EndTime\": 1641831405.3450143, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 72, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 6612610.0, \"count\": 1, \"min\": 6612610, \"max\": 6612610}, \"Total Batches Seen\": {\"sum\": 6644.0, \"count\": 1, \"min\": 6644, \"max\": 6644}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 74.0, \"count\": 1, \"min\": 74, \"max\": 74}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=143799.5371500386 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=73, batch=0 train binary_classification_accuracy =0.749\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=73, batch=0 train binary_classification_cross_entropy =0.561614990234375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=73, batch=0 train binary_f_1.000 =0.8079571537872992\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:45.949] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 148, \"duration\": 601, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=73, train binary_classification_accuracy =0.7332637362637363\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=73, train binary_classification_cross_entropy =0.5746433460948231\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=73, train binary_f_1.000 =0.7704311804261678\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831405.344829, \"EndTime\": 1641831405.9503052, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 604.4995784759521, \"count\": 1, \"min\": 604.4995784759521, \"max\": 604.4995784759521}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #progress_metric: host=algo-1, completed 74.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831405.3457613, \"EndTime\": 1641831405.9505107, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 73, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 6703180.0, \"count\": 1, \"min\": 6703180, \"max\": 6703180}, \"Total Batches Seen\": {\"sum\": 6735.0, \"count\": 1, \"min\": 6735, \"max\": 6735}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 75.0, \"count\": 1, \"min\": 75, \"max\": 75}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=149734.9878104204 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=74, batch=0 train binary_classification_accuracy =0.75\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=74, batch=0 train binary_classification_cross_entropy =0.5608095092773437\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:45 INFO 139736811280192] #quality_metric: host=algo-1, epoch=74, batch=0 train binary_f_1.000 =0.808282208588957\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:46.589] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 150, \"duration\": 636, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:46 INFO 139736811280192] #quality_metric: host=algo-1, epoch=74, train binary_classification_accuracy =0.7336153846153847\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:46 INFO 139736811280192] #quality_metric: host=algo-1, epoch=74, train binary_classification_cross_entropy =0.5737680087246738\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:46 INFO 139736811280192] #quality_metric: host=algo-1, epoch=74, train binary_f_1.000 =0.770581944483878\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831405.950374, \"EndTime\": 1641831406.5906696, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 639.5013332366943, \"count\": 1, \"min\": 639.5013332366943, \"max\": 639.5013332366943}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:46 INFO 139736811280192] #progress_metric: host=algo-1, completed 75.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831405.9511352, \"EndTime\": 1641831406.590944, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 74, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 6793750.0, \"count\": 1, \"min\": 6793750, \"max\": 6793750}, \"Total Batches Seen\": {\"sum\": 6826.0, \"count\": 1, \"min\": 6826, \"max\": 6826}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 76.0, \"count\": 1, \"min\": 76, \"max\": 76}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:46 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=141527.14813258345 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:46 INFO 139736811280192] #quality_metric: host=algo-1, epoch=75, batch=0 train binary_classification_accuracy =0.75\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:46 INFO 139736811280192] #quality_metric: host=algo-1, epoch=75, batch=0 train binary_classification_cross_entropy =0.5600149536132812\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:46 INFO 139736811280192] #quality_metric: host=algo-1, epoch=75, batch=0 train binary_f_1.000 =0.808282208588957\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:47.205] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 152, \"duration\": 612, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=75, train binary_classification_accuracy =0.733912087912088\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=75, train binary_classification_cross_entropy =0.572902847457718\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=75, train binary_f_1.000 =0.7707181274145898\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831406.5907567, \"EndTime\": 1641831407.2068207, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 615.119457244873, \"count\": 1, \"min\": 615.119457244873, \"max\": 615.119457244873}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #progress_metric: host=algo-1, completed 76.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831406.5916722, \"EndTime\": 1641831407.2070932, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 75, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 6884320.0, \"count\": 1, \"min\": 6884320, \"max\": 6884320}, \"Total Batches Seen\": {\"sum\": 6917.0, \"count\": 1, \"min\": 6917, \"max\": 6917}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 77.0, \"count\": 1, \"min\": 77, \"max\": 77}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=147136.46920297714 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=76, batch=0 train binary_classification_accuracy =0.751\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=76, batch=0 train binary_classification_cross_entropy =0.5592310791015624\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=76, batch=0 train binary_f_1.000 =0.8089025326170376\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:47.839] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 154, \"duration\": 629, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=76, train binary_classification_accuracy =0.7344175824175824\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=76, train binary_classification_cross_entropy =0.5720477737594437\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=76, train binary_f_1.000 =0.7709845541552165\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831407.206908, \"EndTime\": 1641831407.8398826, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 632.1601867675781, \"count\": 1, \"min\": 632.1601867675781, \"max\": 632.1601867675781}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #progress_metric: host=algo-1, completed 77.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831407.20769, \"EndTime\": 1641831407.840156, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 76, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 6974890.0, \"count\": 1, \"min\": 6974890, \"max\": 6974890}, \"Total Batches Seen\": {\"sum\": 7008.0, \"count\": 1, \"min\": 7008, \"max\": 7008}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 78.0, \"count\": 1, \"min\": 78, \"max\": 78}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=143170.91660671032 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=77, batch=0 train binary_classification_accuracy =0.751\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=77, batch=0 train binary_classification_cross_entropy =0.5584578857421875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:47 INFO 139736811280192] #quality_metric: host=algo-1, epoch=77, batch=0 train binary_f_1.000 =0.8089025326170376\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:48.466] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 156, \"duration\": 623, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:48 INFO 139736811280192] #quality_metric: host=algo-1, epoch=77, train binary_classification_accuracy =0.7348571428571429\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:48 INFO 139736811280192] #quality_metric: host=algo-1, epoch=77, train binary_classification_cross_entropy =0.57120264007233\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:48 INFO 139736811280192] #quality_metric: host=algo-1, epoch=77, train binary_f_1.000 =0.7712682251673207\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831407.839964, \"EndTime\": 1641831408.4675572, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 626.7299652099609, \"count\": 1, \"min\": 626.7299652099609, \"max\": 626.7299652099609}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:48 INFO 139736811280192] #progress_metric: host=algo-1, completed 78.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831407.840795, \"EndTime\": 1641831408.4678297, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 77, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 7065460.0, \"count\": 1, \"min\": 7065460, \"max\": 7065460}, \"Total Batches Seen\": {\"sum\": 7099.0, \"count\": 1, \"min\": 7099, \"max\": 7099}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 79.0, \"count\": 1, \"min\": 79, \"max\": 79}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:48 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144410.58659394147 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:48 INFO 139736811280192] #quality_metric: host=algo-1, epoch=78, batch=0 train binary_classification_accuracy =0.752\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:48 INFO 139736811280192] #quality_metric: host=algo-1, epoch=78, batch=0 train binary_classification_cross_entropy =0.5576951904296875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:48 INFO 139736811280192] #quality_metric: host=algo-1, epoch=78, batch=0 train binary_f_1.000 =0.8092307692307692\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:49.116] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 158, \"duration\": 645, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=78, train binary_classification_accuracy =0.734912087912088\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=78, train binary_classification_cross_entropy =0.5703673323746566\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=78, train binary_f_1.000 =0.7712180271431417\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831408.467642, \"EndTime\": 1641831409.116835, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 648.247480392456, \"count\": 1, \"min\": 648.247480392456, \"max\": 648.247480392456}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #progress_metric: host=algo-1, completed 79.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831408.4685547, \"EndTime\": 1641831409.117117, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 78, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 7156030.0, \"count\": 1, \"min\": 7156030, \"max\": 7156030}, \"Total Batches Seen\": {\"sum\": 7190.0, \"count\": 1, \"min\": 7190, \"max\": 7190}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 80.0, \"count\": 1, \"min\": 80, \"max\": 80}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=139619.95503530026 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=79, batch=0 train binary_classification_accuracy =0.752\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=79, batch=0 train binary_classification_cross_entropy =0.5569429931640625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=79, batch=0 train binary_f_1.000 =0.8089368258859785\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:49.753] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 160, \"duration\": 633, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=79, train binary_classification_accuracy =0.7351208791208791\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=79, train binary_classification_cross_entropy =0.569541726583963\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=79, train binary_f_1.000 =0.771265894856709\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831409.1169279, \"EndTime\": 1641831409.754632, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 636.807918548584, \"count\": 1, \"min\": 636.807918548584, \"max\": 636.807918548584}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #progress_metric: host=algo-1, completed 80.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831409.1177914, \"EndTime\": 1641831409.754871, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 79, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 7246600.0, \"count\": 1, \"min\": 7246600, \"max\": 7246600}, \"Total Batches Seen\": {\"sum\": 7281.0, \"count\": 1, \"min\": 7281, \"max\": 7281}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 81.0, \"count\": 1, \"min\": 81, \"max\": 81}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=142142.3965264219 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=80, batch=0 train binary_classification_accuracy =0.754\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=80, batch=0 train binary_classification_cross_entropy =0.556201171875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:49 INFO 139736811280192] #quality_metric: host=algo-1, epoch=80, batch=0 train binary_f_1.000 =0.8101851851851852\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:50.380] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 162, \"duration\": 622, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:50 INFO 139736811280192] #quality_metric: host=algo-1, epoch=80, train binary_classification_accuracy =0.7356593406593407\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:50 INFO 139736811280192] #quality_metric: host=algo-1, epoch=80, train binary_classification_cross_entropy =0.5687256912399125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:50 INFO 139736811280192] #quality_metric: host=algo-1, epoch=80, train binary_f_1.000 =0.7715986669072057\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831409.754723, \"EndTime\": 1641831410.3809242, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 625.4885196685791, \"count\": 1, \"min\": 625.4885196685791, \"max\": 625.4885196685791}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:50 INFO 139736811280192] #progress_metric: host=algo-1, completed 81.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831409.755409, \"EndTime\": 1641831410.381125, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 80, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 7337170.0, \"count\": 1, \"min\": 7337170, \"max\": 7337170}, \"Total Batches Seen\": {\"sum\": 7372.0, \"count\": 1, \"min\": 7372, \"max\": 7372}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 82.0, \"count\": 1, \"min\": 82, \"max\": 82}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:50 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144722.58380697566 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:50 INFO 139736811280192] #quality_metric: host=algo-1, epoch=81, batch=0 train binary_classification_accuracy =0.754\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:50 INFO 139736811280192] #quality_metric: host=algo-1, epoch=81, batch=0 train binary_classification_cross_entropy =0.555469482421875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:50 INFO 139736811280192] #quality_metric: host=algo-1, epoch=81, batch=0 train binary_f_1.000 =0.8101851851851852\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:51.000] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 164, \"duration\": 617, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=81, train binary_classification_accuracy =0.7360549450549451\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=81, train binary_classification_cross_entropy =0.5679191022600446\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=81, train binary_f_1.000 =0.7718148222038552\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831410.3809896, \"EndTime\": 1641831411.0015748, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 619.7948455810547, \"count\": 1, \"min\": 619.7948455810547, \"max\": 619.7948455810547}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #progress_metric: host=algo-1, completed 82.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831410.381749, \"EndTime\": 1641831411.0018506, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 81, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 7427740.0, \"count\": 1, \"min\": 7427740, \"max\": 7427740}, \"Total Batches Seen\": {\"sum\": 7463.0, \"count\": 1, \"min\": 7463, \"max\": 7463}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 83.0, \"count\": 1, \"min\": 83, \"max\": 83}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=146023.56472553176 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=82, batch=0 train binary_classification_accuracy =0.754\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=82, batch=0 train binary_classification_cross_entropy =0.5547479248046875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=82, batch=0 train binary_f_1.000 =0.8101851851851852\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:51.651] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 166, \"duration\": 646, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=82, train binary_classification_accuracy =0.7361758241758242\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=82, train binary_classification_cross_entropy =0.5671218208061469\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=82, train binary_f_1.000 =0.771787072243346\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831411.0016556, \"EndTime\": 1641831411.6524293, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 649.8026847839355, \"count\": 1, \"min\": 649.8026847839355, \"max\": 649.8026847839355}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #progress_metric: host=algo-1, completed 83.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831411.0025907, \"EndTime\": 1641831411.6527095, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 82, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 7518310.0, \"count\": 1, \"min\": 7518310, \"max\": 7518310}, \"Total Batches Seen\": {\"sum\": 7554.0, \"count\": 1, \"min\": 7554, \"max\": 7554}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 84.0, \"count\": 1, \"min\": 84, \"max\": 84}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=139274.37983950443 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=83, batch=0 train binary_classification_accuracy =0.754\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=83, batch=0 train binary_classification_cross_entropy =0.5540363159179688\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:51 INFO 139736811280192] #quality_metric: host=algo-1, epoch=83, batch=0 train binary_f_1.000 =0.8101851851851852\u001b[0m\n", "\n", "2022-01-10 16:17:08 Uploading - Uploading generated training model\u001b[34m[2022-01-10 16:16:52.270] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 168, \"duration\": 615, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=83, train binary_classification_accuracy =0.7364945054945055\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=83, train binary_classification_cross_entropy =0.566333724137191\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=83, train binary_f_1.000 =0.7719521821415325\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831411.6525145, \"EndTime\": 1641831412.2712865, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 617.805004119873, \"count\": 1, \"min\": 617.805004119873, \"max\": 617.805004119873}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #progress_metric: host=algo-1, completed 84.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831411.6534538, \"EndTime\": 1641831412.2714877, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 83, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 7608880.0, \"count\": 1, \"min\": 7608880, \"max\": 7608880}, \"Total Batches Seen\": {\"sum\": 7645.0, \"count\": 1, \"min\": 7645, \"max\": 7645}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 85.0, \"count\": 1, \"min\": 85, \"max\": 85}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=146519.3622974202 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=84, batch=0 train binary_classification_accuracy =0.754\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=84, batch=0 train binary_classification_cross_entropy =0.5533345947265625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=84, batch=0 train binary_f_1.000 =0.8101851851851852\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:52.901] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 170, \"duration\": 625, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=84, train binary_classification_accuracy =0.7366703296703296\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=84, train binary_classification_cross_entropy =0.565554683475704\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=84, train binary_f_1.000 =0.7720176198042032\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831412.2713516, \"EndTime\": 1641831412.901983, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 629.8420429229736, \"count\": 1, \"min\": 629.8420429229736, \"max\": 629.8420429229736}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #progress_metric: host=algo-1, completed 85.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831412.2721088, \"EndTime\": 1641831412.9022546, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 84, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 7699450.0, \"count\": 1, \"min\": 7699450, \"max\": 7699450}, \"Total Batches Seen\": {\"sum\": 7736.0, \"count\": 1, \"min\": 7736, \"max\": 7736}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 86.0, \"count\": 1, \"min\": 86, \"max\": 86}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=143697.70875384705 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=85, batch=0 train binary_classification_accuracy =0.753\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=85, batch=0 train binary_classification_cross_entropy =0.5526426391601562\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:52 INFO 139736811280192] #quality_metric: host=algo-1, epoch=85, batch=0 train binary_f_1.000 =0.8092664092664092\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:53.541] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 172, \"duration\": 636, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:53 INFO 139736811280192] #quality_metric: host=algo-1, epoch=85, train binary_classification_accuracy =0.7369230769230769\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:53 INFO 139736811280192] #quality_metric: host=algo-1, epoch=85, train binary_classification_cross_entropy =0.5647845733977936\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:53 INFO 139736811280192] #quality_metric: host=algo-1, epoch=85, train binary_f_1.000 =0.7721345491233748\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831412.9020674, \"EndTime\": 1641831413.5423365, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 639.2529010772705, \"count\": 1, \"min\": 639.2529010772705, \"max\": 639.2529010772705}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:53 INFO 139736811280192] #progress_metric: host=algo-1, completed 86.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831412.9030514, \"EndTime\": 1641831413.5426164, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 85, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 7790020.0, \"count\": 1, \"min\": 7790020, \"max\": 7790020}, \"Total Batches Seen\": {\"sum\": 7827.0, \"count\": 1, \"min\": 7827, \"max\": 7827}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 87.0, \"count\": 1, \"min\": 87, \"max\": 87}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:53 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=141582.32235221332 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:53 INFO 139736811280192] #quality_metric: host=algo-1, epoch=86, batch=0 train binary_classification_accuracy =0.754\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:53 INFO 139736811280192] #quality_metric: host=algo-1, epoch=86, batch=0 train binary_classification_cross_entropy =0.5519603271484375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:53 INFO 139736811280192] #quality_metric: host=algo-1, epoch=86, batch=0 train binary_f_1.000 =0.8098918083462133\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:54.225] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 174, \"duration\": 680, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=86, train binary_classification_accuracy =0.7371648351648352\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=86, train binary_classification_cross_entropy =0.5640232450045072\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=86, train binary_f_1.000 =0.7722355540319201\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831413.5424216, \"EndTime\": 1641831414.2265632, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 683.2003593444824, \"count\": 1, \"min\": 683.2003593444824, \"max\": 683.2003593444824}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #progress_metric: host=algo-1, completed 87.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831413.543332, \"EndTime\": 1641831414.2268746, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 86, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 7880590.0, \"count\": 1, \"min\": 7880590, \"max\": 7880590}, \"Total Batches Seen\": {\"sum\": 7918.0, \"count\": 1, \"min\": 7918, \"max\": 7918}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 88.0, \"count\": 1, \"min\": 88, \"max\": 88}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=132474.56919919583 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=87, batch=0 train binary_classification_accuracy =0.755\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=87, batch=0 train binary_classification_cross_entropy =0.5512874145507812\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=87, batch=0 train binary_f_1.000 =0.8102246320681642\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:54.857] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 176, \"duration\": 628, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=87, train binary_classification_accuracy =0.7374725274725275\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=87, train binary_classification_cross_entropy =0.5632705789083963\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=87, train binary_f_1.000 =0.7723981555580961\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831414.2266557, \"EndTime\": 1641831414.8584754, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 630.8016777038574, \"count\": 1, \"min\": 630.8016777038574, \"max\": 630.8016777038574}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #progress_metric: host=algo-1, completed 88.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831414.2276402, \"EndTime\": 1641831414.858736, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 87, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 7971160.0, \"count\": 1, \"min\": 7971160, \"max\": 7971160}, \"Total Batches Seen\": {\"sum\": 8009.0, \"count\": 1, \"min\": 8009, \"max\": 8009}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 89.0, \"count\": 1, \"min\": 89, \"max\": 89}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=143478.71255278782 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=88, batch=0 train binary_classification_accuracy =0.755\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=88, batch=0 train binary_classification_cross_entropy =0.5506239013671875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:54 INFO 139736811280192] #quality_metric: host=algo-1, epoch=88, batch=0 train binary_f_1.000 =0.8102246320681642\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:55.489] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 178, \"duration\": 627, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:55 INFO 139736811280192] #quality_metric: host=algo-1, epoch=88, train binary_classification_accuracy =0.7376483516483516\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:55 INFO 139736811280192] #quality_metric: host=algo-1, epoch=88, train binary_classification_cross_entropy =0.5625264510270004\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:55 INFO 139736811280192] #quality_metric: host=algo-1, epoch=88, train binary_f_1.000 =0.772489898604864\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831414.858557, \"EndTime\": 1641831415.4903278, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 630.9337615966797, \"count\": 1, \"min\": 630.9337615966797, \"max\": 630.9337615966797}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:55 INFO 139736811280192] #progress_metric: host=algo-1, completed 89.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831414.859368, \"EndTime\": 1641831415.490529, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 88, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 8061730.0, \"count\": 1, \"min\": 8061730, \"max\": 8061730}, \"Total Batches Seen\": {\"sum\": 8100.0, \"count\": 1, \"min\": 8100, \"max\": 8100}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 90.0, \"count\": 1, \"min\": 90, \"max\": 90}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:55 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=143474.5941217727 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:55 INFO 139736811280192] #quality_metric: host=algo-1, epoch=89, batch=0 train binary_classification_accuracy =0.756\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:55 INFO 139736811280192] #quality_metric: host=algo-1, epoch=89, batch=0 train binary_classification_cross_entropy =0.5499696044921875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:55 INFO 139736811280192] #quality_metric: host=algo-1, epoch=89, batch=0 train binary_f_1.000 =0.8108527131782945\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:56.116] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 180, \"duration\": 623, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=89, train binary_classification_accuracy =0.7379670329670329\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=89, train binary_classification_cross_entropy =0.5617907178270948\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=89, train binary_f_1.000 =0.7726601008704606\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831415.4903932, \"EndTime\": 1641831416.116703, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 625.5078315734863, \"count\": 1, \"min\": 625.5078315734863, \"max\": 625.5078315734863}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #progress_metric: host=algo-1, completed 90.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831415.491161, \"EndTime\": 1641831416.116962, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 89, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 8152300.0, \"count\": 1, \"min\": 8152300, \"max\": 8152300}, \"Total Batches Seen\": {\"sum\": 8191.0, \"count\": 1, \"min\": 8191, \"max\": 8191}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144696.3993622174 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=90, batch=0 train binary_classification_accuracy =0.757\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=90, batch=0 train binary_classification_cross_entropy =0.549324462890625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=90, batch=0 train binary_f_1.000 =0.8111888111888111\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:56.789] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 182, \"duration\": 670, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=90, train binary_classification_accuracy =0.7381538461538462\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=90, train binary_classification_cross_entropy =0.5610632609273051\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=90, train binary_f_1.000 =0.7726986549651818\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831416.1167955, \"EndTime\": 1641831416.7909462, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 673.398494720459, \"count\": 1, \"min\": 673.398494720459, \"max\": 673.398494720459}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #progress_metric: host=algo-1, completed 91.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831416.1175165, \"EndTime\": 1641831416.7914379, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 90, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 8242870.0, \"count\": 1, \"min\": 8242870, \"max\": 8242870}, \"Total Batches Seen\": {\"sum\": 8282.0, \"count\": 1, \"min\": 8282, \"max\": 8282}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 92.0, \"count\": 1, \"min\": 92, \"max\": 92}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=134367.53363184287 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=91, batch=0 train binary_classification_accuracy =0.758\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=91, batch=0 train binary_classification_cross_entropy =0.548688232421875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:56 INFO 139736811280192] #quality_metric: host=algo-1, epoch=91, batch=0 train binary_f_1.000 =0.8118195956454122\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:57.417] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 184, \"duration\": 621, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:57 INFO 139736811280192] #quality_metric: host=algo-1, epoch=91, train binary_classification_accuracy =0.7383626373626374\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:57 INFO 139736811280192] #quality_metric: host=algo-1, epoch=91, train binary_classification_cross_entropy =0.5603439394772708\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:57 INFO 139736811280192] #quality_metric: host=algo-1, epoch=91, train binary_f_1.000 =0.7727953736485004\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831416.7911916, \"EndTime\": 1641831417.4178638, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 625.676155090332, \"count\": 1, \"min\": 625.676155090332, \"max\": 625.676155090332}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:57 INFO 139736811280192] #progress_metric: host=algo-1, completed 92.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831416.7921548, \"EndTime\": 1641831417.418135, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 91, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 8333440.0, \"count\": 1, \"min\": 8333440, \"max\": 8333440}, \"Total Batches Seen\": {\"sum\": 8373.0, \"count\": 1, \"min\": 8373, \"max\": 8373}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 93.0, \"count\": 1, \"min\": 93, \"max\": 93}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:57 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=144651.54951716575 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:57 INFO 139736811280192] #quality_metric: host=algo-1, epoch=92, batch=0 train binary_classification_accuracy =0.76\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:57 INFO 139736811280192] #quality_metric: host=algo-1, epoch=92, batch=0 train binary_classification_cross_entropy =0.5480609130859375\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:57 INFO 139736811280192] #quality_metric: host=algo-1, epoch=92, batch=0 train binary_f_1.000 =0.8130841121495327\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:58.027] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 186, \"duration\": 606, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=92, train binary_classification_accuracy =0.7386923076923076\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=92, train binary_classification_cross_entropy =0.5596326438149253\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=92, train binary_f_1.000 =0.7730253424330645\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831417.4179487, \"EndTime\": 1641831418.0281808, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 609.3063354492188, \"count\": 1, \"min\": 609.3063354492188, \"max\": 609.3063354492188}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #progress_metric: host=algo-1, completed 93.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831417.4188442, \"EndTime\": 1641831418.0283775, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 92, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 8424010.0, \"count\": 1, \"min\": 8424010, \"max\": 8424010}, \"Total Batches Seen\": {\"sum\": 8464.0, \"count\": 1, \"min\": 8464, \"max\": 8464}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 94.0, \"count\": 1, \"min\": 94, \"max\": 94}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=148564.0445225047 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=93, batch=0 train binary_classification_accuracy =0.76\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=93, batch=0 train binary_classification_cross_entropy =0.5474422607421875\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=93, batch=0 train binary_f_1.000 =0.8130841121495327\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:58.670] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 188, \"duration\": 638, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=93, train binary_classification_accuracy =0.7388681318681318\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=93, train binary_classification_cross_entropy =0.5589292357727722\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=93, train binary_f_1.000 =0.773087096435358\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831418.028245, \"EndTime\": 1641831418.6714082, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 642.3604488372803, \"count\": 1, \"min\": 642.3604488372803, \"max\": 642.3604488372803}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #progress_metric: host=algo-1, completed 94.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831418.029022, \"EndTime\": 1641831418.6716652, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 93, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 8514580.0, \"count\": 1, \"min\": 8514580, \"max\": 8514580}, \"Total Batches Seen\": {\"sum\": 8555.0, \"count\": 1, \"min\": 8555, \"max\": 8555}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 95.0, \"count\": 1, \"min\": 95, \"max\": 95}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=140903.71752054515 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=94, batch=0 train binary_classification_accuracy =0.76\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=94, batch=0 train binary_classification_cross_entropy =0.5468321533203125\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:58 INFO 139736811280192] #quality_metric: host=algo-1, epoch=94, batch=0 train binary_f_1.000 =0.8127925117004681\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:59.293] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 190, \"duration\": 618, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=94, train binary_classification_accuracy =0.7390549450549451\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=94, train binary_classification_cross_entropy =0.5582335932804988\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=94, train binary_f_1.000 =0.773182287089749\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831418.6714933, \"EndTime\": 1641831419.2938242, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 621.4230060577393, \"count\": 1, \"min\": 621.4230060577393, \"max\": 621.4230060577393}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #progress_metric: host=algo-1, completed 95.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831418.6723678, \"EndTime\": 1641831419.2941, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 94, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 8605150.0, \"count\": 1, \"min\": 8605150, \"max\": 8605150}, \"Total Batches Seen\": {\"sum\": 8646.0, \"count\": 1, \"min\": 8646, \"max\": 8646}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 96.0, \"count\": 1, \"min\": 96, \"max\": 96}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=145639.85481948472 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=95, batch=0 train binary_classification_accuracy =0.761\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=95, batch=0 train binary_classification_cross_entropy =0.5462305908203124\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=95, batch=0 train binary_f_1.000 =0.8134270101483216\u001b[0m\n", "\u001b[34m[2022-01-10 16:16:59.942] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 192, \"duration\": 644, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=95, train binary_classification_accuracy =0.7391318681318682\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=95, train binary_classification_cross_entropy =0.5575455842070527\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=95, train binary_f_1.000 =0.773181987559836\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831419.2939117, \"EndTime\": 1641831419.9432967, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 648.3800411224365, \"count\": 1, \"min\": 648.3800411224365, \"max\": 648.3800411224365}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #progress_metric: host=algo-1, completed 96.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831419.2948852, \"EndTime\": 1641831419.9435303, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 95, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 8695720.0, \"count\": 1, \"min\": 8695720, \"max\": 8695720}, \"Total Batches Seen\": {\"sum\": 8737.0, \"count\": 1, \"min\": 8737, \"max\": 8737}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 97.0, \"count\": 1, \"min\": 97, \"max\": 97}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=139599.53435232042 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=96, batch=0 train binary_classification_accuracy =0.761\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=96, batch=0 train binary_classification_cross_entropy =0.5456373291015625\u001b[0m\n", "\u001b[34m[01/10/2022 16:16:59 INFO 139736811280192] #quality_metric: host=algo-1, epoch=96, batch=0 train binary_f_1.000 =0.8134270101483216\u001b[0m\n", "\u001b[34m[2022-01-10 16:17:00.556] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 194, \"duration\": 608, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=96, train binary_classification_accuracy =0.7395274725274725\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=96, train binary_classification_cross_entropy =0.5568650901710595\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=96, train binary_f_1.000 =0.7734610201565502\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831419.9433784, \"EndTime\": 1641831420.5570662, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 612.8404140472412, \"count\": 1, \"min\": 612.8404140472412, \"max\": 612.8404140472412}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:00 INFO 139736811280192] #progress_metric: host=algo-1, completed 97.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831419.9441924, \"EndTime\": 1641831420.5573509, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 96, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 8786290.0, \"count\": 1, \"min\": 8786290, \"max\": 8786290}, \"Total Batches Seen\": {\"sum\": 8828.0, \"count\": 1, \"min\": 8828, \"max\": 8828}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 98.0, \"count\": 1, \"min\": 98, \"max\": 98}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:00 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=147674.93365324286 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=97, batch=0 train binary_classification_accuracy =0.76\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=97, batch=0 train binary_classification_cross_entropy =0.5450521850585938\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:00 INFO 139736811280192] #quality_metric: host=algo-1, epoch=97, batch=0 train binary_f_1.000 =0.8125\u001b[0m\n", "\u001b[34m[2022-01-10 16:17:01.199] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 196, \"duration\": 639, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=97, train binary_classification_accuracy =0.7397142857142858\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=97, train binary_classification_cross_entropy =0.5561919820596883\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=97, train binary_f_1.000 =0.7735650644334825\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831420.557151, \"EndTime\": 1641831421.2000437, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 641.8743133544922, \"count\": 1, \"min\": 641.8743133544922, \"max\": 641.8743133544922}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #progress_metric: host=algo-1, completed 98.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831420.5581372, \"EndTime\": 1641831421.200313, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 97, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 8876860.0, \"count\": 1, \"min\": 8876860, \"max\": 8876860}, \"Total Batches Seen\": {\"sum\": 8919.0, \"count\": 1, \"min\": 8919, \"max\": 8919}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 99.0, \"count\": 1, \"min\": 99, \"max\": 99}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=140928.07664198644 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=98, batch=0 train binary_classification_accuracy =0.76\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=98, batch=0 train binary_classification_cross_entropy =0.5444751586914063\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=98, batch=0 train binary_f_1.000 =0.8125\u001b[0m\n", "\u001b[34m[2022-01-10 16:17:01.878] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 198, \"duration\": 674, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=98, train binary_classification_accuracy =0.7400879120879121\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=98, train binary_classification_cross_entropy =0.5555261495401571\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=98, train binary_f_1.000 =0.7738252338057261\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831421.2001293, \"EndTime\": 1641831421.8801017, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 678.7352561950684, \"count\": 1, \"min\": 678.7352561950684, \"max\": 678.7352561950684}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #progress_metric: host=algo-1, completed 99.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831421.2013304, \"EndTime\": 1641831421.8803692, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 98, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 8967430.0, \"count\": 1, \"min\": 8967430, \"max\": 8967430}, \"Total Batches Seen\": {\"sum\": 9010.0, \"count\": 1, \"min\": 9010, \"max\": 9010}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 100.0, \"count\": 1, \"min\": 100, \"max\": 100}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=133359.07051201037 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=99, batch=0 train binary_classification_accuracy =0.76\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=99, batch=0 train binary_classification_cross_entropy =0.543906005859375\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:01 INFO 139736811280192] #quality_metric: host=algo-1, epoch=99, batch=0 train binary_f_1.000 =0.8125\u001b[0m\n", "\u001b[34m[2022-01-10 16:17:02.640] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/train\", \"epoch\": 200, \"duration\": 757, \"num_examples\": 91, \"num_bytes\": 5796480}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #quality_metric: host=algo-1, epoch=99, train binary_classification_accuracy =0.7403846153846154\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #quality_metric: host=algo-1, epoch=99, train binary_classification_cross_entropy =0.5548674681946472\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #quality_metric: host=algo-1, epoch=99, train binary_f_1.000 =0.7740553361195857\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #quality_metric: host=algo-1, train binary_classification_accuracy =0.7403846153846154\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #quality_metric: host=algo-1, train binary_classification_cross_entropy =0.5548674681946472\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #quality_metric: host=algo-1, train binary_f_1.000 =0.7740553361195857\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831421.8802214, \"EndTime\": 1641831422.6409938, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"update.time\": {\"sum\": 759.9465847015381, \"count\": 1, \"min\": 759.9465847015381, \"max\": 759.9465847015381}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #progress_metric: host=algo-1, completed 100.0 % of epochs\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831421.881015, \"EndTime\": 1641831422.641231, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 99, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 9058000.0, \"count\": 1, \"min\": 9058000, \"max\": 9058000}, \"Total Batches Seen\": {\"sum\": 9101.0, \"count\": 1, \"min\": 9101, \"max\": 9101}, \"Max Records Seen Between Resets\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Max Batches Seen Between Resets\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}, \"Reset Count\": {\"sum\": 101.0, \"count\": 1, \"min\": 101, \"max\": 101}, \"Number of Records Since Last Reset\": {\"sum\": 90570.0, \"count\": 1, \"min\": 90570, \"max\": 90570}, \"Number of Batches Since Last Reset\": {\"sum\": 91.0, \"count\": 1, \"min\": 91, \"max\": 91}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #throughput_metric: host=algo-1, train throughput=119118.0284281723 records/second\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 WARNING 139736811280192] wait_for_all_workers will not sync workers since the kv store is not running distributed\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] Pulling entire model from kvstore to finalize\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831422.6410701, \"EndTime\": 1641831422.644376, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"finalize.time\": {\"sum\": 2.814054489135742, \"count\": 1, \"min\": 2.814054489135742, \"max\": 2.814054489135742}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] Saved checkpoint to \"/tmp/tmpnvyopssg/state-0001.params\"\u001b[0m\n", "\u001b[34m[2022-01-10 16:17:02.653] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/test\", \"epoch\": 0, \"duration\": 64888, \"num_examples\": 1, \"num_bytes\": 64000}\u001b[0m\n", "\u001b[34m[2022-01-10 16:17:02.693] [tensorio] [info] epoch_stats={\"data_pipeline\": \"/opt/ml/input/data/test\", \"epoch\": 1, \"duration\": 39, \"num_examples\": 10, \"num_bytes\": 603520}\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831422.6533854, \"EndTime\": 1641831422.69375, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"Meta\": \"test_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 9430.0, \"count\": 1, \"min\": 9430, \"max\": 9430}, \"Total Batches Seen\": {\"sum\": 10.0, \"count\": 1, \"min\": 10, \"max\": 10}, \"Max Records Seen Between Resets\": {\"sum\": 9430.0, \"count\": 1, \"min\": 9430, \"max\": 9430}, \"Max Batches Seen Between Resets\": {\"sum\": 10.0, \"count\": 1, \"min\": 10, \"max\": 10}, \"Reset Count\": {\"sum\": 1.0, \"count\": 1, \"min\": 1, \"max\": 1}, \"Number of Records Since Last Reset\": {\"sum\": 9430.0, \"count\": 1, \"min\": 9430, \"max\": 9430}, \"Number of Batches Since Last Reset\": {\"sum\": 10.0, \"count\": 1, \"min\": 10, \"max\": 10}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #test_score (algo-1) : ('binary_classification_accuracy', 0.703711558854719)\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #test_score (algo-1) : ('binary_classification_cross_entropy', 0.5863975905158487)\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #test_score (algo-1) : ('binary_f_1.000', 0.759469696969697)\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #quality_metric: host=algo-1, test binary_classification_accuracy =0.703711558854719\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #quality_metric: host=algo-1, test binary_classification_cross_entropy =0.5863975905158487\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192] #quality_metric: host=algo-1, test binary_f_1.000 =0.759469696969697\u001b[0m\n", "\u001b[34m#metrics {\"StartTime\": 1641831422.6444497, \"EndTime\": 1641831422.6946008, \"Dimensions\": {\"Algorithm\": \"factorization-machines\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"setuptime\": {\"sum\": 22.34053611755371, \"count\": 1, \"min\": 22.34053611755371, \"max\": 22.34053611755371}, \"totaltime\": {\"sum\": 64966.24970436096, \"count\": 1, \"min\": 64966.24970436096, \"max\": 64966.24970436096}}}\u001b[0m\n", "\u001b[34m[01/10/2022 16:17:02 INFO 139736811280192 integration.py:636] worker closed\u001b[0m\n", "\n", "2022-01-10 16:17:39 Completed - Training job completed\n", "Training seconds: 158\n", "Billable seconds: 158\n" ] } ], "source": [ "fm = sagemaker.estimator.Estimator(container,\n", " get_execution_role(), \n", " train_instance_count=1, \n", " train_instance_type='ml.c4.xlarge',\n", " output_path=output_prefix,\n", " sagemaker_session=sagemaker.Session())\n", "\n", "fm.set_hyperparameters(feature_dim=nbFeatures,\n", " predictor_type='binary_classifier',\n", " mini_batch_size=1000,\n", " num_factors=64,\n", " epochs=10)\n", "\n", "fm.fit({'train': train_data, 'test': test_data})" ] }, { "cell_type": "markdown", "id": "be78c999", "metadata": {}, "source": [ "50 epoch 이후 테스트 정확도는 71.5% 이고 F1 점수 (이진 분류기의 일반적인 메트릭) 는 0.75입니다 (1은 완벽한 분류기를 나타냄) - 이는 매번 조금씩 달라질 수 있습니다. 좋지는 않지만 sparse 행렬과 protobuf 로 인해 하이퍼 파라미터를 조정하는 데 많은 시간을 소비하지 않았습니다.\n", "\n", "[01/29/2018 13:42:41 INFO 140015814588224] #test_score (algo-1) : binary_classification_accuracy\n", "\n", "[01/29/2018 13:42:41 INFO 140015814588224] #test_score (algo-1) : 0.7159\n", "\n", "[01/29/2018 13:42:41 INFO 140015814588224] #test_score (algo-1) : binary_classification_cross_entropy\n", "\n", "[01/29/2018 13:42:41 INFO 140015814588224] #test_score (algo-1) : 0.581087609863\n", "\n", "[01/29/2018 13:42:41 INFO 140015814588224] #test_score (algo-1) : binary_f_1.000\n", "\n", "[01/29/2018 13:42:41 INFO 140015814588224] #test_score (algo-1) : 0.74558968389\n", "\n" ] }, { "cell_type": "markdown", "id": "a0e7654f", "metadata": {}, "source": [ "### Deploy model\n" ] }, { "cell_type": "code", "execution_count": 51, "id": "69b39bd3", "metadata": {}, "outputs": [], "source": [ "from sagemaker.deserializers import JSONDeserializer\n", "from sagemaker.serializers import JSONSerializer\n", "\n", "class FMSerializer(JSONSerializer):\n", " def serialize(self, data):\n", " js = {'instances': []}\n", " for row in data:\n", " js['instances'].append({'features': row.tolist()})\n", " return json.dumps(js)" ] }, { "cell_type": "code", "execution_count": 52, "id": "93f1b2ec", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "------!" ] } ], "source": [ "from time import strftime, gmtime\n", "timestamp = strftime('%d-%H-%M-%S', gmtime())\n", "\n", "fm_predictor = fm.deploy(\n", " endpoint_name = 'movielens-{}'.format(timestamp),\n", " initial_instance_count=1,\n", " instance_type='ml.c4.xlarge',\n", " serializer=FMSerializer(),\n", " deserializer= JSONDeserializer())" ] }, { "cell_type": "markdown", "id": "cca07aee", "metadata": {}, "source": [ "### Run predictions\n" ] }, { "cell_type": "code", "execution_count": 54, "id": "fea2b592", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "{'predictions': [{'score': 0.5318580269813538, 'predicted_label': 1.0}, {'score': 0.25228151679039, 'predicted_label': 0.0}, {'score': 0.2844095826148987, 'predicted_label': 0.0}, {'score': 0.5023573040962219, 'predicted_label': 1.0}, {'score': 0.4511873126029968, 'predicted_label': 0.0}, {'score': 0.2788926661014557, 'predicted_label': 0.0}, {'score': 0.3577846586704254, 'predicted_label': 0.0}, {'score': 0.4581504762172699, 'predicted_label': 0.0}, {'score': 0.3485219478607178, 'predicted_label': 0.0}, {'score': 0.2731906473636627, 'predicted_label': 0.0}]}\n", "[0. 0. 0. 0. 0. 0. 1. 0. 0. 0.]\n" ] } ], "source": [ "result = fm_predictor.predict(X_test[1000:1010].toarray(), initial_args={\"ContentType\": \"application/json\"})\n", "print(result)\n", "print (Y_test[1000:1010])" ] }, { "cell_type": "code", "execution_count": null, "id": "3964bd62", "metadata": {}, "outputs": [], "source": [] } ], "metadata": { "kernelspec": { "display_name": "conda_python3", "language": "python", "name": "conda_python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.8.12" } }, "nbformat": 4, "nbformat_minor": 5 }