logs

16bit/TinyStories fp16 768.log

@@ -0,0 +1,730 @@
+Global seed: 1337
+found vocab_size = 96 (inside data/TinyStories/meta.pkl)
+Initializing a new model from scratch
+number of parameters: 85.03M
+using fused AdamW: False
+
+step 250: train loss 2.2698, val loss 2.2686
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+zeamm End to wa the smeay the futhed he fad hey watondally.
+Sthe Hid ly tond wer.
+Heis the t than t tad mano wahe thery they we.
+Sthely the S co d heay fo s h tuppid she tom.
+Toreray he t cashe thero id ily he came ld ly the te hand witond d mmpe py he thesheve fry ththas t hend h momundithe anendnd fre the homerupplle the he habas p s tu aloutired lils tand h pld ther and therfan itha asasthe t tth ld hed the t held he balan bbe thefothilfead t py hecatt he thed by t the tond ld buthey!
+
+step 500: train loss 1.7654, val loss 1.7642
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+A lil day, ta loled way sand her, wimy sal att was squy. Fro haw, but was caly caly bad ant spreansed. The da so loled, fou drearked sputed. They to orke tog theire and feacoulfu ond the gevery.
+
+step 750: train loss 1.1099, val loss 1.0979
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Oncece upon," asked it a could rabit the cretwar was very late.
+The could picice was and had pick down was him the face. The butterfly was felt a buttery white high mude his mum a home to his pet out of your and his horm.
+The little girl was he was very hearted to he neightly and he out of his beloom.
+The friends was excited! From that day, His couldn't so the parket the sourd to shick it with he had been a bird.
+
+step 1000: train loss 0.8210, val loss 0.8199
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+One, one. It was a perful junce. In the purple around a purple puppy. It looked at the perftle and taked the purple and showed it in his air.
+One day, a purple paster in the fog and saw a big playing on a child. It was so cold and jumped on the held. It had to wait for a long lass and carried it. The purple played with door and float the park. With was a ball with jungle show playing.
+The next day, the purple bounced in her pocket in her child. The purple perened a long child up and said, "I want to take packackagagagagagon?" The purple said, "No, if your friends for my paw animal pon the fog. Let's play way down the purple down, if it for a mewher friend let to play with.
+
+step 1250: train loss 0.7088, val loss 0.7056
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+One morning, the doctor gave her a big hug and said, "I'm glad wear! I was so cute and here grings that they need it began to each others." The doctor looked at her grin and said, "Okay, we can touch something new." The doctor had found a beautiful velvet doctor.
+
+step 1500: train loss 0.6419, val loss 0.6478
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little girl named Lily. She was a very curious calm for her wardrobe. One day, she noticed a girl named Tom. She gave her a big hug. She said, "Tom, can I have some cookies."
+Tom said, "Sure. That's cookies in your room where you have some same." Lily did not like that. She said, "Tom, can I have some same same, orange?"
+Tom said, "No, Let's see what is inside."
+Lily said, "One, that's a same tree. It's so pretty. You'll have some food."
+Tom said, "No, Let's go. I wanted to have same same same sad, orange, same salad same. It has red stories, orange where there, and you will have some mess!"
+Tom said, "Are is amazed and orange, Tom. You've understand, too."
+Lily was sad and said, "Thank you, same same tree to street, orange me to have such a same time from your room." Tom said, "You've love same tree too it and stretching to the same snack."
+They continued to love it around the room. They saw Mom's room bike and said, "Red, Look, Lily, where there?"
+Lily said, "No, mom. There's norme is a room for your tree. You are doner."
+Tom happily waved to them and said, "Thank you, same, found the same same tree. You're broken to mess and stretch, and to me have a good friend."
+
+step 1750: train loss 0.6065, val loss 0.6068
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little girl called Lily. She loved to run and play in her garden when she wanted to play outside in the gored too. One day, she went to the garden and asked her owhat it was.
+Lily was so excited. Her own asked her to help her plant with the others. They wanted to be asked her narews.
+So, they asked her friend Tom to open the door. Tom was a great washman to keep it. They said, "Don't worry, Lily. We love you." Tom said, "I am sorry I didn't think because you should be a good friend." Lily nodded and they smiled as they played together. From that day on, Tom and the great that they both could usit and play together every day.
+
+step 2000: train loss 0.5781, val loss 0.5748
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+The little girl was with in her backyard. She had to go to school every day. She and her dad were was too scared so they could fix her school and get home. So they started walking around the little girl's backyard. Her dad had a surprise. The little girl was very sad because she was there and she had lost her toy. Her dad saw her and he came to help her.
+The two of them realized that their dad was too weak and not too heavy. They hugged Lily and told her that they were so bored and wanted to enjoy things too. The end.
+
+step 2250: train loss 0.5459, val loss 0.5476
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once there was a little boy who was three years old. He loved to play dress-up. He had a beautiful dress that he found in a big garden. One day he was playing with his dress when saw a fluffy growing stroll in his backyard.
+The next day he heard a voice say, "Do you have a fluffy discovery?" The voice said, "Yes!"
+The voice replied, "I love fluffy, it's me loyal to him."
+The next day, the voice replaced his dress up and skipped off. He spotted a circle around the garden, and the circle shook was running.
+The voice smiled and said, "I know how to fluffy! I was doing a grown-up!"
+The voice smiled and said, "Yay! I was making sure you're ok."
+So the little boy started to fluff up and landed on the circle. After a while, he said goodbye to the circle. The voice was sad with how sweet and soft the grown-up.
+From then on, the little boy became a fluffy dragove!
+
+step 2500: train loss 0.5239, val loss 0.5355
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Lila was a big girl who liked to help her mom in the kitchen. One day, Lila wanted to help her mom in the kitchen. She was having so much fun to go outside, but she didn't know what to do.
+"Mom, I want to help," she said. "I think I have broken my way."
+"No, Lila, we have to do it! We don't know what we make mistakes," her mom said together. "We have to dry a little bit of water or names," Lila said.
+So, Lila put her water over her head and started to comb. Her mom saw her and said, "Lila, I told you to go to the store and play with me and then we can find a way to play together."
+Lila was happy and her mom was proud of her. She was big and strong, but she learned a lesson today about the girls and the way. She also learned to be kind and helpful to others, even if they are still when they are free.
+
+step 2750: train loss 0.5101, val loss 0.5086
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little girl named Jane. Jane loved to play hockey in her backyard. One day, while she was finished bringing, the sun was getting hot. Jane was having a great time, and she noticed a blackboard new garden! She wanted to touch the blackboard, so she asked her mom if she could ride it. Her mom said yes, and Jane asked the blackboard for help.
+Together, the blackboard started to build a noise. Jane smiled and said, "I am going on a big adventure!" Her mom helped Jane and the blackboard started to reach the garden. Jane was very excited, she didn't know how to ride the blackboard.
+When they opened the bottom she saw a butterfly. It was so beautiful! Jane was happy to help. The blackboard said, "Thank you so much! I know how to ride the butterfly!" Jane was so proud that she had the blackboard. She knew that she would ride the butterfly windowstant soon!
+
+step 3000: train loss 0.4975, val loss 0.5014
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Mommy was busy first. She was busy dreaming of cookies. She smiled and hugged them.
+"There, are you Lily?" Anna asked.
+"We love you too, Daddy. They are beautiful," Mommy said.
+"I love you too, Anna and Ben. I love you very much. Thank you for the cookies, for your help and a big day. And then you are very husband," Mommy said.
+"Thank you, Mommy. You are the best." Anna said.
+"You are welcome, Anna. Busy don't feed or grateful for everyone. You are my smart sister," Mommy said.
+Mommy smiled and hugged them. "I love you very much. You are my lucky daughter, too. I am proud, too. I love you very much."
+
+step 3250: train loss 0.4879, val loss 0.4910
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little girl named Lily. She loved to play with her toys all day long. One day, her mother asked her to help her with something. Lily said, "Okay, we can see that farm first!"
+While they were waiting for the family to see, Lily saw a big billboard. She thought it was so big and funny. So, she asked her mother, "Can we feed the billboard to come eat with me?" Her mother smiled and said, "Sure, but we have to put some feathers in the billboard."
+Lily was very excited and they went to the billboard. They put some feathers in the billboard and shared them with the billboard. Lily felt happy that she could help her mother when they needed it. She fell asleep dreaming of all the feathers in her mother's billboard.
+
+step 3500: train loss 0.4785, val loss 0.4770
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time there was a boat. The big boat was big and it lived in a nearby lake. One day, the boat met a little frog who wanted to play with it. The frog said to the little bird, "I can eat you!" The little bird said, "No, you can't eat me because you are not helping."
+The frog said, "You can be my friend! I can share my toys with you!" The little bird said, "Thank you! I will be your friend!" So, they shared the toys together and became friends.
+The little bird was happy to have shared the toys and learned that listening can make you happy and smart. From that day on, they all played together with the toys and shared them together.
+
+step 3750: train loss 0.4662, val loss 0.4682
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little girl named Lily. She loved to play outside in the yard. One day, Lily's mom was too busy running out of the yard. It was a very hot day, and she wanted to hurry.
+Lily saw a butterfly fluttering on the ground. She picked it up and tried to zip around it. She was so excited and pretended she was exploring it.
+Suddenly, Lily saw a big, scary monster who was stuck behind a rock bush. Lily's mom turned on the light and the monster said, "Let Mr. Monster, don't do that. Be brave and keep the hot day safe."
+Lily smiled and felt happy knowing that she could do anything and itch things do something good.
+
+step 4000: train loss 0.4631, val loss 0.4682
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little girl named Lily. She loved to play with her toys, especially her favorite toy. One day, she went to the park to play with her friends. They were having so much fun that they didn't notice her thermometer on her hand.
+Lily's mom came to the rescue and asked her what she was doing. Lily told her mom about her toys and how she was making a shape. Her mom explained that it's important to count the shape of others, and that ways it's best to show all of others.
+Lily's mom was proud of her for wanting to try her shape with a new toy. She learned how to ask her mom if she could reach it, and Lily was proud of herself for wanting to do it again. From that day on, she always kept her toys close to her, just in case she could show them her mom waiting to be careful.
+
+step 4250: train loss 0.4626, val loss 0.4614
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a boy named Timmy. Timmy was very excited because he was going to go to celebrate his birthday. He packed his perfect puppets and set out to work.
+When he got to celebration, he saw that it was about a big, strong mountain which had a big mess with three bists on it. The people had no idea why, so Timmy decided to do something different.
+When he started to clean his room, he pretended to be a castle. He pretended to be a pirate and said "Arrr, matata!" He didn't notice and spotted a shiny, gold cloud in the sky. Timmy knew it was going to be a beautiful use and he wanted to have it.
+But when the day came, Timmy went outside to play. He saw a big, strong wind that looked like something was different than he didn't understand. The room was a big success and there was no success. Timmy was sad that he couldn't play with his imagination anymore, but he was happy that he had learned a valuable lesson.
+
+step 4500: train loss 0.4503, val loss 0.4548
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a big pit. It was very brown and it liked to keep it best from any danger. One day, a little girl named Lily went into the pit with her mom. They saw the pit and said, "Mommy, look at that pit! Can we keep it?"
+Mommy said, "Sure, we can keep it as a pet. But be careful with it." Lily hugged the pit and promised to never touch it again. From that day on, Lily always remembered to be careful and keep the pit safe.
+
+step 4750: train loss 0.4539, val loss 0.4484
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+There was a girl who loved to spend time with her family. She always wanted to go on adventures and find out what they would find. One day, they asked the girl to spend time together on a big boat. The girl was a bit scared but she trusted it.
+When they arrived at the boat, the girl found lots of boats and toys and seats to start pranging games. The girl was very excited to see the boats and the fish spending their time on the boats. She had never forgotten the lesson she learned from her special boats from her before.
+When the girl got home, she looked for her boat and found it in the pond. She was very proud of her work, and she wanted to show it to her friends. She was very happy to have a family and now it tasted even better here.
+
+step 5000: train loss 0.4478, val loss 0.4470
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a family who needed help. The mother and father were sad and miserable for their hose.
+The father wanted to help his daughter, so he put the father in his wallet and said, "If the family had some medicine, please go away and getting a normal drink."
+The daughter was sad, so she carefully placed one of the father's hand and the father began to begin to think of a normal problem. He carefully asked the family in a happy voice, "What kind of family is this?"
+The family was delighted and said, "It's medicine!"
+The family was so happy that they started to enjoy their day inside. As soon as the family turned on the family went home, the mother smiled and said, "That was fair. My daughter yelled out and said, "Thank you for caring for me!"
+
+step 5250: train loss 0.4398, val loss 0.4424
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+The sun was shining and the birds were singing. Lily loved to play in the grass and pick flowers. One day, she saw a little girl who had a piano in her hand. She had a piano in her hand.
+"Hi, Lily, can I play with you?" she asked.
+"No, you cannot play with my piano. It is mine!" Lily said.
+"But I like this piano too. It is fun and strong and pretty. Please, Lily, let me play with your piano instead!" the piano beeped.
+Lily felt angry and sad. She thought the piano was very bad and polite. She went to the girl and shook her head.
+"Please, give me your piano! It is old and special and I can break it! I want to make it strong and smart and intelligent!" she said.
+The little girl was surprised and angry. She did not think it was a good idea. She threw her piano away and took it back.
+Lily was very sad and very impatient. She did not want to share her piano with anyone.
+"Why did you take it from my piano? It made me silly and bored!" she said.
+The piano felt very bad. It wanted to stop Lily, but it was too late. It was too late and too fast.
+Lily stopped making mistakes and hugged the piano. She tried to fix the piano, but it was gone.
+Lily was left with a bad ending. She knew she had shouted at her mom and tried to help her. But her mom did not believe her and took the piano. She put back the piano in a different way and asked Lily to stop laughing at her mistake.
+Lily was very sad and cried a lot. She wished she had never shared her piano with the animals she made.
+
+step 5500: train loss 0.4329, val loss 0.4345
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a family who lived in a small house with a big yard. The dad and the family loved to play in the yard every day.
+One morning, the family started to close their eyes and smiled. He knew something new was going to be a great idea.
+"Daddy, what do you have there?" asked their child.
+"I have an idea!" said the mother.
+The family scooped up their mouths and began to pull out the picture of the trees.
+After a while, their wings started to hurt. But something shining up!
+"This is so cool!" said their dad.
+The family looked up at the trees and smiled. Addien was happy that he had made new friends in the park.
+
+step 5750: train loss 0.4330, val loss 0.4324
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little girl named Lily. She loved to play outside in the park. One day, she went to the park with her mommy. They saw a man sitting in a big bike near the bike. She wore a red hat and a whistle.
+As they were riding, they saw a man with a big house. The man had a camera and a whistle. He was a recert! Lily's mommy took out a camera and a tightrope for a take-side. She also put the camera around his nose and had a pretend tightrope.
+After they finished their camera, Lily's mommy gave him a big hug. She told him that it's important to be smart and help others. Lily listened to her mommy's advice and promised to always be kind to herself and help others.
+
+step 6000: train loss 0.4294, val loss 0.4291
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Little Jack was running in the park one day. He needed to get his supperhero toy bucket. He was ready, but a bit scared. The stairs were covered with stairs, and Jack was bossy. He wanted the toy bucket for himself. He tried to get his toy bucket but it was a stubborn little boy. He thought it was dangerous.
+Jack had found some money to himself. He was so excited that he wanted the toy a little bit more to play with it. He thought that it was too harsh for him. So he started to plead the toy but it would not let him.
+Suddenly Jack's mom shouted, "Jack! What do you think you're doing there?" Jack looked up and saw her. He started to worry. He was disappointed that he was dancing around the park.
+But then Jack saw his mom walking towards him. She smiled and said "Jack, why are you so thoughtful?". Jack smiled back and said, "I'm just trying to find my passport, Mommy. But I can't let it go."
+
+step 6250: train loss 0.4302, val loss 0.4246
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+One day a little girl named Mia was feeling shy. She was alone in the forest and wanted to have fun. She saw a big rock and took it with her to climb it.
+Mia saw a very impressive tree with a heavy leaf. The climb was so high that she couldn't see the top. She asked her mom, "What is that tree?" Her mom said, "That's a leaf, and it's very important to climb the tree."
+Mia was so excited to learn something new. She climbed the tree and climbed higher and higher until she could see the very top. It was a beautiful view!
+Mia felt relaxed and happy. She ran back to her home, feeling excited and proud of herself for finding such a big and impressive tree.
+
+step 6500: train loss 0.4243, val loss 0.4211
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little girl named Lily. She loved to play with her toy car. One day, Lily's little brother, Max, came into her room and saw the cars. He wanted to play with it too, so he reached for it at first. Lily was sad and didn't know what to do.
+Max wanted to help Lily, so he tried to take out the cars and try to solve them. But Lily was not so good at fighting because she couldn't get them for herself. She felt angry and helpless because she couldn't stop playing.
+Lily tried again and again, but she just couldn't convince her brother. Finally, Lily got tired and decided to take off the cars. She went to her room and started playing with them. And sure enough, she soon got tired and decided to take out her own cars and try again. She worked hard and solved the problem. Eventually, Lily was proud of herself for being brave and solving the problem of fighting too.
+
+step 6750: train loss 0.4203, val loss 0.4247
+Once upon a time, there was a small girl named Lily. She loved to play on the beach with her friends. One day, Lily's mom told her that they were going on a trip to visit her grandma. Lily was excited and her mom said, "We need to set off at a dock first!"
+As they walked through the big hall, Lily's mom said, "It's time to go to grandma's house!" Lily didn't want to go because she was having so much fun. She wanted to play on the trip, but her mom said it was too far away. Lily got upset and said, "I don't want to leave my house!"
+But then, Lily remembered that her grandma was very small and her mom said she had an extra time playing at the hall. So, Lily decided to set off and play at the hall. When they arrived, Lily saw her grandma playing with a ball. She wanted to play with the ball too, but her grandma said no because she was looking for her ball.
+Lily realized that it was not nice to be naughty and have her ball back. She apologized to her grandma and gave her back the ball. Her grandma was happy to hear that and gave Lily a big hug. From that day on, Lily always remembered to be honest and listen to her grandma when she told her to be careful.
+
+step 7000: train loss 0.4204, val loss 0.4196
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little boy named Timmy. Timmy loved to play with cardboard boxes. One day, he found a big, shiny cardboard box in his backyard. He asked his mom what was inside. His mom told him that if he wore it when he grew up, he could create something new.
+Timmy was so happy and he worked very hard for his art box. He made a big cardboard box for his friends to play with. He found some old cardboard boxes and started to create a new toy. In the box, he made a yummy, shiny tomato cake for his friends.
+Timmy was so proud of his work he decided to create the university when he grew up. He loved creating something new and he shared it with his friends. They all said thank you and Timmy felt happy too. From that day on, Timmy was known as the Open University.
+
+step 7250: train loss 0.4164, val loss 0.4153
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Anna and Ben are friends. They like to play with clay. They can make different shapes and animals with the clay. Anna can make a snake, a tiger, a bird or a train. Ben can make a house with clay.
+One day, they find a big clay that is not the same as the others. It is a releason. Anna and Ben invite the releason to have some clay. They show the pieces to their friends and show them the clay.
+"Look, Ben, I made a snake!" Anna says. She shows Ben how to use her mouth. She makes a loud noise.
+"That is fun!" Ben says. He shows Anna how to make a bird or a train. They start to make more clay.
+But then, the releason gets worse. The pieces spill on the floor. The clay makes a mess. The releason bursts. The glass spills all over the room.
+"Ouch!" Ben cries. He drops the scissors. He hears a loud bang.
+"Ben, Ben, what happened?" Ben asks. He runs to the room. He sees the mess.
+Anna and Ben are sad. They look at the scissors. They try to clean the clay. But the scissors are not the same. They are small and dark.
+"Ben, Ben, come here!" Anna says. She grabs the scissors. She pulls her tears. She hugs Ben.
+"Ben, Ben, what were you doing?" Anna asks. She sees the clay. She feels sorry. She knows the scissors are not the same.
+"We wanted to make a fort, Anna," Ben says. He sees the clay on the table. He sees the scissors too. He knows Anna liked to clean the clay.
+"We are sorry, Ben," Anna says. She sees the clay on the floor. She is not angry. She is kind.
+
+step 7500: train loss 0.4164, val loss 0.4147
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time there was a little girl who was always so scared. One day she went to the store with her mother to buy some milk. When they got there, the little girl wanted to pick some milk but she could not find anything. Luckily, the storekeeper said they would go to the store together.
+The little girl was so excited for her first time at the store. She found the milk and put them in the supplies. Then, she took out some milk and poured it on the store. She carefully put the milk in the supplies and put them on the last one.
+After they finished, the little girl thanked the storekeeper and ran home. Her mother gave her a lot of storybooks and told her she was so brave. The little girl was so happy and she kept the storekeeper safe in her and never forgot the lesson she learned.
+
+step 7750: train loss 0.4181, val loss 0.4155
+Once upon a time, there was a little girl named Lily. She loved to play outside and pick flowers. One day, she saw a butterfly and chased it. It flew away and Lily felt embarrassed because she didn't want to leave the butterfly behind.
+But then she had an idea. She went inside her house and asked her mom if she could pick up the butterfly. Her mom said they could pick it up and put it in their tree.
+Lily was so happy to pick up the butterfly and they went outside to play with their friends. She learned that it's important to be kind and find things that don't belong to others.
+
+step 8000: train loss 0.4112, val loss 0.4073
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little girl named Lily. She loved to play outside in the grass and look at the flowers. One day, she saw a shiny pin on the ground. She picked it up and looked at it closely.
+As she was looking at the pin, she saw a small bird pecking out of the ground. It was so pretty and was singing a song. Lily thought the bird was the best bird in the world.
+When the bird finished eating, Lily showed the bird the pin and said, "Wow, that's a big pin!" As she continued to look at the pin, she noticed that it wasn't as shiny as the bird. It was just as pretty as the bird, but now it was missing friends.
+Lily asked her mom if they could buy a new pin for the bird that felt like the one she lost. Her mom said, "Yes, we can buy a new pin. It will make you happy inside." Lily felt happy that they could make a new friend.
+
+step 8250: train loss 0.4134, val loss 0.4112
+Tom and Anna are best friends. They like to play in the park with their moms. One day, they see a big truck with many bikes. The bikes are red and shiny. Tom and Anna want to touch them.
+"Can I have the bike?" Tom asks Anna.
+"No, it is mine now. You had your own bikes." Anna says.
+"Please, can I try your bike?" Tom asks.
+"No, go away. I want to ride my bike." Anna says.
+They start to fight over the bikes. They pull and push and shout. The bikes fall on the ground. The bikes roll away. Tom and Anna are sad.
+They look at each other. They feel sorry. They have an idea.
+"Let's share the bikes. It is perfect." Tom says.
+They pick up the bikes and run to the slide. They take more bikes and go down. They feel better and happy. They do not care who will win the bikes. They have fun in the park.
+
+step 8500: train loss 0.4081, val loss 0.4093
+Lily and Ben are friends. They like to play in the park. One day, they see a big sign with pictures of animals and cars. The sign says: "Birds And Lake God".
+"Wow, they are rich!" Lily says. "Let's go to them and see!"
+"No, thank you," Ben says. "They are bad and nasty. They will make us sick."
+Lily and Ben are sad. They want to see the birds and cars and cars. They walk to the sign and look. They see the sky and the clouds. They hear the animals. They are afraid.
+A man sees them and asks what are wrong. They tell him about the sign. The man tells them about the sign. He says: "If you remember what you said, you can stay away from the sign. And look at the sign to tell the animals. They sign up for it."
+Lily and Ben follow the man. They see the sign too. They see the sign. They see the sign. They see the colors and the sky. They see the birds too. They are happy. They wave at the man. They run back to the park.
+They tell their mom and dad about the sign. Their mom and dad smile. They say: "You saved the day, Lily and Ben. The sign was not angry. The animals were throwing stones for the park. They were not meant to scare you. They were just learning." Lily and Ben are proud. They hug the man. They are happy too. They look at the elderly man. He is worried. He is at the sign. He sees a cherry and anted cats. He is not happy. He is reading a book of stones. He sees Lily and Ben. He is reading a book.
+
+step 8750: train loss 0.4082, val loss 0.4122
+Once upon a time, there was a little girl named Lily. She loved to play with her toys and run around in her backyard. One day, she saw a big telephone on the ground. It was colorful and had a picture of a girl who looked sad. Lily picked it up and said "hello, is anyone there?" The voice was very nice and said "Yes, I am the telephone officer of the money I was given to my family."
+Lily was so happy to hear what the new telephone said. She ran over to her family and said "thank you for the telephone, it's so big and shiny!" Her family was so happy to see her and said "oh wow, thank you for being so patient and gentle." Lily smiled and said "You're welcome, it's all better now that I love my grandma because she cares about me."
+The moral of the story is that it's important to say please and thank you, even if it means saying please and thank you. Maybe tomorrow will bring you something great and I'll send you the same picture of me for your family." Lily thought about it for a moment and then said "I will send my big smile and make your family better." And with that, the two of them said goodbye and Lily went home.
+
+step 9000: train loss 0.4057, val loss 0.4084
+Once upon a time, there was a dependable dog named Max. Max loved to play outside and chase balls. One day, Max was playing with his ball when he ran too far. He lost his ball and couldn't find it.
+Max was sad because he lost his ball. His friend, a little bird named Tweetie, saw Max crying and asked him what was wrong. Max told Tweetie about his lost ball. Tweetie said, "Don't worry, Max. I have an idea! Let's look for it together!"
+They looked high and low for the ball under a big tree. They found it hiding under a branch. They were so happy to find it. Max learned that it's okay to ask for help when you can't find something like that.
+
+step 9250: train loss 0.4046, val loss 0.4056
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Lily was a little girl who liked to play outside. She had many toys and games with her cat, Tom. One day, her mom gave her a big red ball to play with. Lily was very happy and said "This is my ball. It is fun and not hot."
+Tom rolled the ball to Lily and said "Can I play with the ball?" Lily said "Yes, let's play together!" They both played and laughed all day. Lily had a lot of fun with the ball.
+At the end of the day, Lily said "Mom, I want to watch TV. Do you have a good time?" Her mom replied "Of course, dear! What do you want to watch?" Lily replied "I want to watch TV!" Her mom said "Okay, let's go find a cool show!"
+When they were done playing, Lily said "Mom, can you take this ball to me?" Her mom said "Sure, let's see if I can do it too." Lily took the ball and they went to the park. She sat down on a bench and watched the show. The sky was clear and blue, and it was so pretty. Lily was happy and said "This was so fun!"
+
+step 9500: train loss 0.4014, val loss 0.4039
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little girl named Lily. She loved to play with her toys and her favorite toy was a shiny crown that she wore under her bed. One day, Lily went to the park to play with her friends. They played with a ball, but Lily noticed a note on the ground. She picked it up and said, "I found this for you, Mr. Bear."
+Lily was so happy to find the note. She showed it to her friends and said, "Look at this crown! It sparkles in the sun." Her friends said, "That's cool, Lily. Can we play with it?" But Lily refused and said, "No, I don't want to play with it. I want to keep it safe."
+Lily's mom came to the park and saw the note smiling at her. She pointed to the sky and said, "Look at that powerful crown sparkling in the sun! Let's play with it!" Lily was so excited and said, "Yes, let's play with the crown!" They played with the crown for a long time, but then the crown didn't look at Lily's beautiful dress. It stayed in the sun until it was very dark.
+Lily was sad and said, "I love our friend too! He just wanted to play with it." Her friends said, "Maybe we can make more days with it tomorrow." Lily was happy again and said, "Okay, I love our friend too!" From that day on, they all played with the crown together and took good care of it.
+
+step 9750: train loss 0.3979, val loss 0.4044
+Sara and Ben are friends. They like to play with toys. Sara has a doll and Ben has a car. They share their toys and have fun.
+One day, Sara and Ben want to play with the doll. They take the doll to Sara's room. They put her doll in the trash. They say, "No trash. Trash is good."
+After a while, Sara and Ben go back to the living room. They see their toys and their shiny cars. They say, "No trash is good. Trash is bad."
+They are jealous of each other. They say, "No, that is not fair. Trash is bad. We will find another toy to play with."
+Sara and Ben are sad. They say, "Sorry. We are friends. We will not be jealous. We will be happy."
+They put the doll and the cars back in the trash. They go to Sara's room. They take the doll and the cars. They are happy.
+They play with the doll for a long time. They do not fight. They have fun. They are good friends. The end.
+
+step 10000: train loss 0.3969, val loss 0.4033
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Jane was very excited. She was going to a party. She quickly got ready to go. She ran to the door and opened it. When she saw all the decorations she was even more eager to fill with her family. She was so excited.
+When she got to the party, Jane was so excited. She saw the best games ever. There were cars and trucks and buses. Jane got to do some exercise like a bed and start business. Everyone was having so much fun!
+When it was time to go home, Jane was sad to leave. She had been exercise for so long, but now she was wearing her special decorations. She was happy she worked hard and she promised herself that she would never forget the fun she had.
+
+step 10250: train loss 0.3985, val loss 0.3995
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little boy named Timmy. Timmy loved to play in the garden. He was always looking for new things to discover. One day, Timmy found a delicate peach tree. He was so excited to show his mom. But as he was planting the peach, he heard a loud noise. It was the elephant that was having sprung up into the ground. Timmy knew that it was wrong to have a peach tree and asked his mom to plant it there. She agreed and gave him a pile of rocks to plant in the ground. Timmy carefully planted the peach and watered it every day. Soon, the peach tree grew more and more. Timmy was happy to have found something to discover and make things clear again.
+
+step 10500: train loss 0.4020, val loss 0.3999
+Sara was very happy. She liked to play with her crayons. She had many colors and shapes. She liked to stack them and make them into shapes. She liked to count them and show them to her mom and dad.
+One day, Sara found a big crayon in her closet. It was shiny and round and had a cut on it. Sara wanted to play with it. She loved the crayon and did not want to share it. She picked it up and took it to her room. She decided to stack the crayon very quietly. She wanted to make a hat for her dolls.
+She thought of a plan. She ran to her closet and could find something to stack the crayon. She opened the door and saw a big box. She opened it and saw many things inside. There were animals, cars, monkeys, birds, and even some nuts. They were very squishy and cute. She rolled a fake ball into the box. She made a cake, pops, and even a rabbit. She was very happy with her ball. She thought she had made a hat by being gentle with it.
+She took out the ball and played with it for a long time. She pretended it was a super hat that could make anything she wanted. She felt like a princess. She had a very colorful hat. She looked at herself in the mirror. She liked her hat. She wore it to school. She did not want it to break anything else. She thought it was the best hat ever.
+
+step 10750: train loss 0.3930, val loss 0.3991
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little boy named Timmy. Timmy loved to play in his backyard with his dog, Max. One day, Timmy saw a butterfly fluttering around. He wanted to catch it, so he ran after it.
+Suddenly, Timmy saw a big red ball. He ran over to it and tried to catch it. But the ball was too fast and he dropped it. Max barked and growled. Timmy decided to try and chase the ball away.
+After a while, Max caught the ball and gave it back to Timmy. Timmy was happy and they played together for a while. Then, they saw a tree with a big hole in it. Timmy said "Let's go inside the tree. It's safe there." So, they went into the tree and climbed up. Inside the hole, they found a big box. It was full of toys. Timmy and Max were so happy and safe in the big box.
+
+step 11000: train loss 0.4041, val loss 0.3980
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little girl named Lily. She loved to play with her dolls and stuffed animals. One day, Lily's friend Tommy came over to play. Tommy was bald and had a big smile. Lily said, "Hi Tommy, I like your balloon. Can I play with it too?" Tommy said, "Yes, but be careful. It's my favorite toy."
+Lily and Tommy played together and had lots of fun. They took turns kicking the ball and rolling the ball. Lily laughed and said, "I love you, Tommy. You're so kind."
+When it was time for Lily to go home, she said, "Tommy, I want to stay and play all day long. I will come back to visit you again." Tommy smiled and said, "I'm glad you had fun, Lily. Let's play again tomorrow." And so, Lily and Tommy went to bed happy, excited for their next fun day to come.
+
+step 11250: train loss 0.4010, val loss 0.3943
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Tom and Jen are playing with blocks. They want to make a big tower. But they have a problem. Blocks are too big for their tower.
+"Let's try again," Tom says. He wants to make the tower bigger. He picks up a real block and a broken block. He puts the broken block on top.
+"OK," Jen says. She picks up a yellow block and a blue block. She puts the block on top. She puts the real block on top.
+"Wow, this is cool," Tom says. He wants to make the tower more higher. He grabs a triangle and a blue block. He puts the block on top. He puts the real block on top of the block.
+"Now we have three blocks," Jen says. She is smaller. She is not so small. She is bigger. She goes up.
+"That's not fair!" Tom says. "We have to take the triangle. The block is not fair."
+He puts the triangle on top of the block. They both push and pull. The block sticks tops. They both fall off the triangle.
+"Oops!" Jen says. "We broke the stick. It was mean."
+They hear a voice. It is Mom. She has come in.
+"What are you doing?" Mom asks. She sees the broken block and the real block and the triangle.
+"We are sorry," Tom says. "We broke the stick. We are playing."
+Mom is not happy. She tells them to stop. She tells them to get away from the other toys. She wrote a new story for them. She wrote a book and how they share and help each other. She wrote a new story for them. They are happy. They dance and sing and laugh. They have a good time. They are happy. Mom loves them.
+
+step 11500: train loss 0.3934, val loss 0.3914
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Lily liked to play with her toys in the living room. She had a big rag that had many colors and flashlights on it. She liked to make it shiny and pretty. She also had a soft bed where she could sleep and eat and sleep.
+One night, her mom came to her room and said, "Lily, it's light outside. You have to welcome your mom or give her a hug or a kiss. She is sleeping and sleeping and only scratching your teeth. It will make you feel better."
+Lily was scared of the dark. She did not like to sleep on her bed or scratching her either teeth. She liked to sleep with her teddy bear, her mom and dad. She wanted to be quiet and nice to her mom and dad.
+She closed her eyes and slept. She heard her mom and dad talking to each other in their own room. They told her stories and sang songs. They told her shows and secrets and jokes were fun. Lily smiled and did not feel scared.
+The next morning, Lily woke up from her nap and ran to the door. She opened her eyes and saw her mom and dad. They were waiting for her at home. Lily felt a little better. She was excited to go to her bedroom and play with her teddy bear. She hugged her teddy bear and fell asleep.
+
+step 11750: train loss 0.3956, val loss 0.3970
+Once upon a time, there was a little girl named Lily. She loved to play with her dolls and toys. One day, she found a magic wand in her toy box. She waved it and said, "Magic wand, please make me happy and forget about making me sad."
+Suddenly, a strange man appeared and said, "What are you doing?" Lily was scared and asked for some magic wands. The man said, "I make you forget about your magic wand. It's not about making you sad or forget." Lily felt sorry for him and said, "Please make me better, I'm still better now."
+The man wouldn't give up and Lily started to wave her hands. She made sure to give him the magic wand, so he wouldn't forget about making happy memories. After a while, the man had made her feel much better and went home with her. Lily thanked the man and said, "I will always be here to have fancy magic wands, just like I wave more."
+
+step 12000: train loss 0.3929, val loss 0.3981
+Once upon a time, there were two best friends, Jack and Jill. Jack and Jill were always together. One day, Jack wanted to have a race. He asked Jill if they wanted to look closer so they could find whatever they wanted.
+But Jack was scared because they didn't want to get lost. He said they should look for treasures.
+Jill was a bit scared but Jack said they should try it out. Jill was brave and let Jack look around the park.
+They looked and looked until they finally found a big pink box that was very shiny. They both smiled and started running to it. Soon, they were at the end of the park, but they were all so happy that they had found the box!
+
+step 12250: train loss 0.3984, val loss 0.3914
+Once upon a time, there was a little bunny named Benny. Benny liked to hop around in the fields and play with his friends. One day, Benny found a big, juicy carrot caught on a bush. He was so happy and took a big bite. But then, he started to feel sick and dizzy. Benny had to take medicine to feel better. He stopped hopping and didn't feel well. It was just a little bunny, but Benny was still feeling sick. His friends were very worried and didn't know what to do. Benny realized that he had to take the carrot out of the bush and surrender it to the doctor. He felt better and the doctor said that Benny was very intelligent for being such a good hopper. From that day on, Benny learned to be more careful when hopping and he made sure to hop more carrot carts slowly.
+
+step 12500: train loss 0.3861, val loss 0.3931
+Once, there was a boy named Jack. He was very spoiled and always wanted things his way. So one day, Jack wanted to have some water to warm himself. So off he went outside to find some water.
+He looked all around and saw a big puddle. He was so excited he couldn't help but he ran over to it. He splashed and looked in the water, and he saw a shiny puddle walking towards him.
+Jack was so excited that he jumped up and got ready to jump around again! He was so spoiled that he didn't even want to stop looking at the puddle.
+Suddenly he heard a loud noise. It was Jack! Jack had followed his way to the puddle and realised what had happened! He had been so spoiled and he now knew what he should have put in the water.
+Jack was sad. He had done something wrong and he felt like nothing better.
+
+step 12750: train loss 0.3968, val loss 0.3887
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time there was a naughty girl. She loved to play tricks on her friends. One day she decided to sang a song. She pressed another button and sang along. Everyone in the town laughed and clapped.
+The naughty girl was happy that she was so naughty. She pressed the button again and sang another song. Even though she wasn't allowed sometimes, she still had fun.
+But after a while, the naughty girl got thirsty. She found her mommy in the kitchen and asked her if she could have some juice. Her mommy said yes and went over to get some juice.
+The naughty girl thought it was a great idea, so she sang and danced with all her smiles. When she was done, everyone in town couldn't believe her eyes! The naughty girl was so proud of her song. From then on she always kept her song proudly safe.
+
+step 13000: train loss 0.3872, val loss 0.3939
+Ben and Lily were twins who liked to play in the garden. One day, they saw a big bow on the fence. It was red and shiny, and it looked very pretty.
+"Let's use the bow as a hat for our car!" Ben said. He ran to the fence and grabbed the bow.
+"No, Ben, that's bad! You will make a big mess!" Lily said. She was afraid of the bow and tears.
+Ben started to cry. He wanted to win the new hat for his car, but he did not know what to say. He also wanted to have a fun time with the bow and his dog.
+Lily hugged Ben and tried to comfort him. She told him her bow's name was Anna. She said she loved him and wanted to make him feel better.
+"Ben, don't cry. We can get a new bow and a new hat. And we can play and have fun together. You are still my friend," Lily said.
+"Thank you, Lily. You are very kind and brave. I'm sorry I was mad," Ben said.
+They ran back to Lily's house and picked a new hat for Anna. They also played with Anna's bow and a new bow. They had fun and forgot about the bow and the new bow. They were happy and grateful.
+
+step 13250: train loss 0.3942, val loss 0.3866
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a boy named Timmy who loved chalk. He dreamed of drawing on the sidewalk and drawing pictures. One day, he saw his friend Billy drawing a flower in a new drawer. Timmy wanted to draw with Billy, so he took his chalk and tried to draw a picture of a flower. But when he tried to draw on it, he couldn't take his chalk anymore.
+Timmy's mom saw him trying to draw on the new drawer and asked him what he was doing. Timmy said, "I wanted to draw a flower. It's so pretty!" His mom replied, "You can draw a face with your chalk. Maybe you can draw with it." Timmy tried his best to draw a face, but it didn't work. Timmy felt sad because he couldn't draw anymore. He said, "I'm not good enough to draw a face in the new drawer. I want to draw more flowers." His mom hugged him and said, "It's okay, Timmy. You can draw more faces. But remember to take your chalk and draw more flowers."
+Timmy learned that sometimes things can make you sad, but you can still draw a flower with your chalk. He promised to be more careful and made sure to take good care of his chalk. His mom was proud of him for trying his best.
+
+step 13500: train loss 0.3865, val loss 0.3812
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time there was a little girl called Lucy. She was three years old and very adventurous. One day Lucy decided she wanted to explore the big place. She looked around and saw so many interesting things. She saw big birds and a soft bed. She was excited and wanted to climb it. But she was scared to go high in the sky without the cold.
+So Lucy decided to stay up late and keep on climbing. She climbed and climbed, finally reaching the very top. She was so happy and she wanted to take it home with her. But she couldn't. She had to listen to her parents and stay safe and healthy.
+So Lucy ignored her parents' warning and stayed safe. She put her hands inside her hand and stayed there, happy and with that feeling in her heart.
+
+step 13750: train loss 0.3909, val loss 0.3901
+Once upon a time, there was a little boy named Timmy. Timmy loved to draw pictures with his crayons. He would draw on paper and cut circles with his sharp crayon.
+One day, Timmy met his friend Billy. Billy was being selfish and didn't want to share his crayons with Timmy. "Give me your crayons, Billy," Timmy said.
+Billy didn't want to give them to Timmy, so he replaced them with a thin piece of paper and gave it to Timmy. Timmy was so happy and thanked Billy. From that day on, Timmy and Billy shared their crayons and never fought over them.
+
+step 14000: train loss 0.3918, val loss 0.3869
+Once upon a time, there was a big, brave lion named Leo. He lived in the jungle and liked to go on adventures.
+One day, Leo wanted to explore the jungle and so he started walking. He wandered over rocks and bushes until he reached a dark cave. He was scared but he wanted to find out what was inside, so he stepped inside.
+Once doors and wires arrived, Leo stepped into the cave. He saw a friendly bear and was very happy to see him.
+The bear said, "If you want to know what I can do if you'd like, you can go inside and have some breakfast."
+Leo said, "Yes please can I?"
+The bear smiled, and said, "Of course you can! Just watch me and I'll show you how to make a trumpet sound!"
+So Leo watched as the bear carefully moved the trumpet in a gentle and tidy way. He felt a sense of gratitude and was so excited that he could go inside and play the trumpet.
+And Leo was happy that he made a new friend.
+
+step 14250: train loss 0.3877, val loss 0.3906
+Once upon a time, there was a boy named Timmy. Timmy loved to play outside in his backyard. One day, he found a big stick lying on the ground. He picked it up and started to play with it.
+Suddenly, the stick slipped from his hand and he fell down. Timmy cried out for help. His mom came running and saw him lying on the ground. "Oh no, Timmy! Are you okay?" she asked.
+Timmy was scared, but he knew his mom was right. "Yes, mommy. I'm okay," he said. His mom helped him put down her toy and they continued exploring the backyard.
+Later that day, Timmy went on a fun adventure to find more treasures. He was having so much fun that he didn't even notice when he met his dog, Max. Max had seen the stick lying on the ground and came running towards it.
+When Timmy found his dog, he was so happy. "Max, I found my treasure!" he said. They both looked at the stick and then played with it again. They discovered many more treasures and had a great time at the end of the day.
+
+step 14500: train loss 0.3875, val loss 0.3868
+Once upon a time, there was a little girl named Lily. She loved to play outside in her backyard. One day, she saw a big storm coming. The sky was dark and the rain was wild.
+Lily's mom came outside and asked her if she was okay. Lily said she was feeling scared. Her mom noticed that Lily was fearful and promised to take her inside.
+As they watched the storm from the window, the sun came out and made the yellow sky a big blue shade. Lily felt much better and went back to playing in her backyard. From that day on, she knew that even though the storm came, she was still a little scared.
+
+step 14750: train loss 0.3845, val loss 0.3875
+Once upon a time, there was a vendor who sold apples. He was very good at stacking his baskets so he could carry them to the store to buy some.
+One day, a little girl saw the vendor stacking his baskets and wanted a stack of them too. She asked him if he wanted to try, and the vendor happily said yes.
+He tried and tried, and he tried a lot. He was so pleased that he could stack his baskets all by himself! He thanked the little girl and gave her a big hug.
+The little girl smiled and returned to the vendor one evening for her family. She told them how much she appreciated the delicious apples and they were all gone.
+The vendor was excited to hear them and thanked them again. Then, he decided to stack his baskets even higher than he could imagine.
+The little girl and her family laughed and smiled as they watched the vendor with a big smile on their faces. They knew that no matter what he did, the vendor was truly a very proud and happy little girl.
+
+step 15000: train loss 0.3873, val loss 0.3845
+Once upon a time there was an ancient monster. He was always very quiet and did not speak to anyone. One day he noticed a little girl frowning. She was scratching her hand and making a sad face.
+The monster asked her what was wrong. The girl said she was lost and did not know how to go home. The monster said he could help her and reached out with his strong arms. He gave her a gentle smile and said "hello". She smiled back and thanked him.
+The monster was affilled with kindness and told her that she did a good thing by helping him. She was so happy and the monster smiled in happiness. From that day on the girl and the ancient monster were the best of friends.
+
+step 15250: train loss 0.3809, val loss 0.3819
+Lily and Max were playing in the park with their ball. They liked to kick the ball to each other and run after it. Sometimes they missed and sometimes they lost the ball. They would look for the ball and search for it again.
+One day, they saw a big sign in the park. It said "Do not touch". They did not know what it meant. They went closer and saw a man with a microscope. He looked interesting. He had many glasses and bugs and stones. He was trying to study.
+"Hello, kids," he said. "Do you know what I am studying today?"
+Lily and Max were surprised. They did not know he was signing for balloons. They felt ashamed. They did not want to talk to him.
+"It's okay," said Lily. "We found a balloon and that's glass. It means there is no bugs on the microscope. It means there are other bugs like the rocks and the dirt."
+"Really?" said Max. "Can we see it?"
+"Sure," said Lily. "Maybe you can."
+They went closer and looked through the microscope. They saw a little bug with wings. They thought it was a worm.
+"Maybe it's lost," said Max.
+"Let's take it to the park and see if we are there," said Lily.
+They put the worm on a leaf and looked at it. It was dirty and greedy. They threw it away.
+"Bye, kids," said Lily. "You are very intelligent."
+"Thank you," said Max. "You are very brave."
+They smiled and looked at the microscope. It was not dirty anymore. It was clean and shiny.
+"We did it!" said Lily. "We saw a new bug!"
+
+step 15500: train loss 0.3867, val loss 0.3778
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Sam and Jen are friends who like to play in the park. One day, they find a big hoop in the grass. They both want to play with it, but there is only one hoop left.
+"I saw it first!" Sam says.
+"No, I saw it first!" Jen says.
+They tug and tug, but neither hoop can grab the hoop, they can't. They try again and again, but they can't get the hoop.
+They want to show the hoop to their friends, but they are sad and angry. They don't know what to do.
+Then, they hear a voice. It is Sam's mom. She has seen them playing with the hoop and the hoop.
+"Sam, Jen, what are you doing?" she asks.
+"We want to play with the hoop, but we can't have it for our game," Sam says.
+"Oh, I have an idea," Jen says. "Why don't we play a game instead? You can play tag with the hoop. It will be fun."
+Sam likes the idea. He and Jen play tag and Sam catches the hoop. They play and laugh and have fun. They show their moms their hoop and ride it. They say their hoop is beautiful and shiny. They are happy and united.
+
+step 15750: train loss 0.3834, val loss 0.3805
+Once upon a time, there was a little boy named Lily. She loved to play outside and explore. One day, she saw a big tree with lots of pretty leaves. She wanted to pick some leaves and put them in her pocket.
+As she was walking, she saw a leaf on the ground. She picked it up and held it in her hands. It was very smooth and shiny. She felt happy and proud to have found something so useful.
+Suddenly, she heard a loud noise. It was a bird with a lot of ash in his beak. Lily was scared and wanted to leave, but she remembered that she had to walk back to the other side of the tree. She started to climb the tree and found a big bird's nest. The bird was harmless and said hello to Lily. She was happy and kept climbing until she reached the top.
+From that day on, Lily loved to climb trees and walk with a smile on her face. She knew that it was better to be safe than sorry for something bad.
+
+step 16000: train loss 0.3871, val loss 0.3821
+Mama and Papa were eager to go on a camp together. So they all gathered in their car, and settled at the camp. Mama said, "We will be gathered surfing while it travels."
+Mama said, "Let's go!"
+Mama and Papa jumped into the car and drove off camping. They drove for a long time and soon they arrived at the camp place.
+Mama said, "Let's get stay for the camp!"
+Mama said, "No, I know it will be fun!"
+So mama, Papa and Mama and Mama took a bus of surfing and travelled to a new camp spot. Everywhere they went, the travel guide was there.
+Mama said, "Look, there's a big, unknown campground!"
+Mama said, "Let's go in and explore!"
+So Mama and Papa did and had a wonderful time exploring the campground. They laughed and played tag, and they even found some new friends.
+At the end of the travel, Mama had a big smile on her face. She said, "Let's travel again soon!"
+Mama said, "Let's do it again soon!"
+Mama and Papa were sure to explore the campground again soon.
+
+step 16250: train loss 0.3810, val loss 0.3817
+Once upon a time, there was a helpful bunny. He liked to hop around the forest. One day, he met a bear who had a big coat.
+"Hi bunny!" said the bear. "What are you doing?"
+"I'm hopping around the forest. Can I hop with you?" asked the bunny.
+"Yes, you can!" said the bear. They both hopped and hopped together as they went on their adventures.
+They hopped from one big lily pad to another by the other big bear. They hopped and hopped until they reached the edge of the forest.
+"That was so much fun!" said the bunny. "Let's do it again soon."
+And they did. So they hopped together every day and had lots of fun. The brown bunny was the best hop he had ever been.
+
+step 16500: train loss 0.3776, val loss 0.3812
+Ben liked to play with his dad's money. He would stir it and make faces and smile. He wanted to be a strong and brave boy. He did not like to stop playing. He did not like to listen to his dad or to his mom. He was afraid of going to school. He wanted to stay home and play in his room.
+One day, his dad had an idea. He said he would show Ben a magic potion. He said she would make him strong and brave. He gave Ben a flashlight and a paper hat. He said the potion would make him brave and smart. Ben thought it was a wild potion. He did not want to hurt Ben's feelings. He wanted to have fun and be happy. He wanted to sleep.
+He turned on the flashlight and felt warm and cozy. He switched it on and switched it on. He blew it and made a wild sound. But the potion still made him smile. He felt more confused and sad. He could not see Ben's eyes. He felt more fearful and more afraid. He could not hear his mom or his dad. He could not fight himself.
+He cried and cried. He could not find Ben. He could not fight himself. He had no more fun and more people. He was alone and scared. He wished he could sleep. But he could not. He had no more fun. He had no more potion. He had no heart. He had nothing.
+
+step 16750: train loss 0.3845, val loss 0.3851
+Once upon a time there was a chubby little bunny. He was called Bunny. Bunny loved to hop around in the grass. Every day he would race with a big Dream Bunny that hopped around him.
+One day, Bunny was feeling especially chubby so he decided to race away. He hopped and hopped until he came to a big hole. Bunny looked around and noticed the chubby little green clouds in the sky. He pointed and stared at them.
+"Come here, clouds!" said Bunny. He wanted to join them and go explore the hole. So Bunny hopped around with joy, racing through the clouds and going very slow.
+At the end of the day, Bunny was tired but he had a big smile on his face. He hopped back to his home, feeling happy and content. He knew he had had his own chubby life and he couldn't wait to race again soon!
+
+step 17000: train loss 0.3839, val loss 0.3798
+Once upon a time there was a wise owl. He lived in a forest and every day he would fly around. One day he saw a fox scurrying across the forest. The wise owl decided to follow and he flew after the fox. The fox was scared at first, but then he was afraid that he was a good fox just like a friendly animal.
+So the wise owl decided to take the fox home. He took the fox home and they had a lot of fun together. After a few hours, the wise owl thought that the fox had led the fox to a new home. The fox was so happy and he felt safe in the wise owl's comfort.
+From then on the wise owl and the fox were the best of friends. Whenever the fox was tired the wise owl would be there to help him out of scary boxes in the forest. The wise owl was always there to lead them to new adventures and they were the best of friends.
+
+step 17250: train loss 0.3795, val loss 0.3814
+Lily and Ben were playing in the park. They liked to dig in the sand and look for shiny things. Sometimes they found coins or rocks or buttons. But one day, they found something very special.
+"Look, Lily, I found a spark!" Ben shouted, holding up a metal thing in his hand.
+"What is it?" Lily asked, showing him the metal thing.
+"I don't know. Let's see!" Ben said, looking around.
+They dug deeper and pulled out a small, round thing. It was a mineral. It was sharp and had a hole in it.
+"Wow, what a shiny thing!" Ben said, excited.
+"Maybe it is a treasure!" Lily said, looking at the mineral.
+They heard a voice behind them. It was a man in a black robe. He was wearing a hat and a badge with a bag.
+"Hello, kids, I am the mineral guard. I found the mineral and threw it to you. It is magic, but it can be very good of you. You can use it to make some sandwiches and fruits. Do you want to try?" he asked.
+"Yes, please!" Ben and Lily said, smiling.
+The guard gave them each a sandwich and a juice box. He told them to check their backpacks and their toys. He let them pick the avocados and start to make their food.
+Ben and Lily each took a little bite of their magic and fruit. They liked it a lot. It was sweet and soft and yummy.
+"Thank you, guard, you are very nice!" Ben said.
+"You're welcome, kids, you are very sweet and generous!" he said.
+
+step 17500: train loss 0.3816, val loss 0.3807
+The little girl was worried. She had not measured her special vase. She was afraid it would be broken because it had fallen off the shelf. She cried and cried. Everything was so sad and uncomfortable.
+The little girl had lost her special vase. She cried and cried and cried. When she was gone, she was so sad that she didn't know what to do. She was so worried that she never went outside to play anymore.
+
+step 17750: train loss 0.3775, val loss 0.3780
+Lily and Max were playing in the park with their toys. They saw a big red truck with a loud noise. It was a fire truck. Lily and Max wanted to see it closer. They ran to the truck and looked inside.
+"Hello, is an ambulance?" Lily asked the firemen.
+"Yes, it is a very big truck. It helps fire with people when they are hurt. Do you know what it is?" one of the firemen asked.
+"No, what is an ambulance?" Lily asked.
+"An ambulance is a very big tree that helps people when there is a fire or a fire. Sometimes it comes to help people when there is a fire. It is a very big truck," the firemen explained.
+"Wow, that is cool. Can we go closer to the fire?" Lily asked.
+"Sure, you can go closer. But you have to wait for the ambulance. And you have to lean on me and look around. That is very fast and strong," the firemen said.
+"Okay, I will try," Lily said. She leaned on the firemen and watched the fire. They saw her touch the fire and thought her block was very pretty. The firemen worked at the scene and the ambulance started to burn.
+"Wow, this is cool. Thank you, firemen. You are very brave and cool," Lily said.
+She was happy and proud. She liked the fire and her story very much. She smiled and hugged the firemen again. She had a lot of fun at the fire truck. She thought it was very cool and fun. She thought she had a good day.
+
+step 18000: train loss 0.3754, val loss 0.3807
+Once upon a time, there was a fine little girl named Lily. She loved to play outside in the grass. One day, she found a twig on the ground. She picked it up and showed it to her mom.
+"Look, Mommy! I found a twig!" Lily said.
+Her mom smiled and said, "That's nice, Lily. But be careful, it might drop and make you sick."
+Lily nodded and put the twig down. Later that day, she went back to playing outside. She forgot all about the twig and the fun she had with her mom.
+
+step 18250: train loss 0.3782, val loss 0.3769
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a boy named Tim. Tim had a style of ice cream. He lived in a small house with his mom and dad. Tim loved his ice cream. He would share it with his friends and family.
+One day, Tim went to the park with his mom. He played with his friends. They had a fun time together. Tim felt happy. He liked to share his ice cream with his friends.
+At night, Tim's mom came to the park. She saw the ice cream and said, "Wow, Tim! You are such a good boy!" Tim smiled and felt proud. He loved sharing his style with his friends. And from that day on, Tim always shared his ice cream with his friends in the park.
+
+step 18500: train loss 0.3785, val loss 0.3792
+Once upon a time, there was a big red bulb. It was so big that it could hardly fit in the little girl's hand. But it was difficult for her to pick it up and hold it tight!
+One day, she decided to try. She tried lifting the bulb, but it just wouldn't move. She became so frustrated that she started crying.
+Her mom came and saw what was happening. She had an idea. She said, "Let's try to wash the bulb, so it can be shiny again."
+So the little girl and her mom tried to wash the bulb. After a few minutes, it was shiny and new again!
+The little girl was so happy and everyone was so proud of her. From that day on, the little girl was very careful with the bulb and never forgot how it can become shiny again!
+
+step 18750: train loss 0.3773, val loss 0.3797
+Once upon a time, there was a little girl named Lily. She loved to play outside in the sun. One day, she saw a big tree with strange fruits. She wanted to eat them, but they were too high for her to reach.
+Lily asked her friend, Timmy, for help. Timmy was very kind and used his long arms to carry the fruits back to her house. She was so happy and proud of herself.
+Lily ate the fruits and smiled. She had been so fit and strong and couldn't wait for the next time there would be some more fruits to eat.
+
+step 19000: train loss 0.3800, val loss 0.3778
+Once upon a time there was a boy named Peter. Peter was very excited. He loved to hug things! He loved hugs.
+One day, Peter was playing with his hugs when one of his hugs started to get wet. He noticed the wet hugs making him soak up the sun. He lay down underneath a big tree and cuddled his hug again.
+Soon enough, the hugs were all perfect. Peter felt so happy and peaceful. He gave his hug a big hug and said goodbye to the hugs. Everyone was happy and waved as he lay there.
+The end.
+
+step 19250: train loss 0.3749, val loss 0.3698
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a big, old lady who lived in a house. She had a lot of luxury things that she loved to care about. One day, she decided to take a car to the market to sell her luxury things.
+On the way, she saw a little boy crying. She asked him why he was crying, but he didn't answer. The old lady gave him a hug and told him that it was okay. She asked the little boy to take care of his toys. The little boy was happy to listen and nodded.
+When they got to the market, the old lady showed her luxury things at the market. She was happy to see all the things she could buy. The little boy was grateful for the old lady's hug and she gave him a big smile. From that day on, the old lady made sure to care for her luxury things and keep them safe.
+
+step 19500: train loss 0.3751, val loss 0.3739
+Once there were two friends, Tim and Jane. Tim was always happy when he was walking in the park to play. Jane was always being kind to everyone around her and they were always laughing together.
+One day, Jane had a question. She asked Tim if she knew whether Tim was better than him and he told her he was to just play in the park all the time. Jane was sad, but she said okay and they continued playing.
+Tim wanted to be the best at running around and playing in the park. Jane thought that was a great idea and they made up. They had so much fun that they didn't even notice that Jane had been watching them all day.
+The next day, Jane asked Tim if he was doing his job. Tim smiled and said he was tired. Jane said she was tired for a few minutes and said she was tired. Tim thought the idea was really a good idea, so he decided to rest for a while.
+Tim was so happy that he could have fun with his brother again. He was happy that his friend was trying something new and that he thought was nice. Jane was happy that they were able to rest and be friends again. They hugged each other and went off to play together in the park.
+
+step 19750: train loss 0.3753, val loss 0.3764
+Once upon a time, there was a little boy named Timmy. Timmy loved to play outside with his friends. One day, Timmy and his friends found a wire on the ground. They were curious to see it better, so they decided to tie it to a tree.
+Timmy's friend, Billy, said, "That wire is too big for us to carry, Timmy."
+Timmy replied, "I know, but maybe we need to find a small stick to make a smaller wire."
+They found a small stick, but they didn't have one like it. Timmy tried to carry it, but it was too heavy.
+Just then, Timmy's mom called out to them. "Timmy, it's time to go inside for dinner!"
+Timmy and his friends ran inside and sat down at the table. "Mom, can you carry this wire for us to show our friends?" Timmy's mom asked.
+Timmy smiled and replied, "Sure, I'll carry it for you to show our friends." They all gathered around the wire, talking and laughing. Timmy was happy that he found such a good friend for his incredible transformation.
+
+step 20000: train loss 0.3811, val loss 0.3759
+Lily and Max were playing in the park. They saw a big slide. Lily wanted to go on the slide, but Max was scared.
+"Come on, Max, it's fun!" Lily said. "You can hold my hand and I'll go first."
+Max shook his head. He did not want to go on the slide. He wanted to swing high. He said, "No, Lily, it's too high. I don't like it. You don't know how to swing."
+Lily smiled. She liked to swing too, but she was not scared. She said, "I know sign. I can sign with my hands. Then we can swing higher and higher."
+Max nodded. He liked Lily's signs. They went to the swings. Lily swung higher and higher. She felt like she was flying.
+But then, she heard a loud row. She looked up. She saw a big dog running towards the swings. The dog was angry. It had a scarf and a tongue. It wanted to bite Lily.
+Lily screamed. She did not want to swing fast. She did not want to be near the dog. She wanted to go back down. She said, "Max, get out of the swing. It's not safe. Come here."
+Max listened to Lily. He got out of the swings. He ran to the swings. He tried to swing. He sat on the seat. He pushed with his feet. He swung high and fast. He felt like he was flying.
+But then, something happened. Sam swung too high. He swung too high. He hit the dog with his stick. The dog yelped. It ran away. It was hurt and scared.
+
+step 20250: train loss 0.3753, val loss 0.3787
+Once upon a time there was a little girl. She had a pet dog who liked to wander around. One day, she wandered to a meadow full of lights and birds rushing around. The little girl was so excited to explore and she ran as fast as she could.
+But, something was different. As she looked around, she saw a big turkey in the middle of the meadow. She watched as the turkey sprang up and down the tracks and around the meadow. She thought it was so cool and started to wander after a long wander.
+At first the little girl was scared, but soon she began to go faster and faster. The meadow looked so different and exciting.
+Suddenly, a miracle happened. A big print of the meadow appeared in the middle of the meadow. The little girl was so amazed at the print that she started to wander around its middle of the meadow.
+The print was a magical picture of it and the little girl was no longer scared or sad. She was so happy that she could see the print and learn something new about it.
+And that is the story of how the little girl raced around the meadow with the miracle of the river.
+
+step 20500: train loss 0.3744, val loss 0.3723
+Once upon a time, there was a girl named Lily. She loved to play outside with her toys. One day, she went to the park to play on the swings. She saw a big, scary bear in the distance. She wanted to play with it, but she was afraid.
+Lily decided to sign her name on the bear's nose with her fingers. She knew the bear was the kind of thing she was going to throw something that made the bear angry. The bear saw Lily and started to chase her. Lily ran as fast as she could and escaped from the bear.
+The bear ate Lily's finger and the bear's nose. Lily was happy that she was safe and continued to play with her toys. She learned that signing can help us solve our problems and that sometimes it's better to sign a solution to our problems.
+
+step 20750: train loss 0.3766, val loss 0.3744
+Once there was a boy and a girl who were two young ages who were best friends. They were always playing together and had lots of fun. One day, the boy had a special surprise for the girl. His bright yellow cap had come alive and was using a piece of string. He wanted to give it to her so she could wear it. The girl was so excited and thanked her friend for the surprise. She put it on and started running around the gym smiling the whole way. Everyone was happy with the gift and they all cheered for the bright yellow cap. The boy and girl had a wonderful day playing together. The end!
+
+step 21000: train loss 0.3729, val loss 0.3683
+saving checkpoint to 768_FP16_TinyStories
+saving shrunk_model to 768_FP16_TinyStories
+Once upon a time, there was a little boy named Timmy. Timmy loved to play with his toys all day long. One day, Timmy's mom asked him to help her in the kitchen. Timmy was so excited to help his mom and she gave him a big bowl to put the pancakes in.
+Timmy was so proud of himself for helping his mom in the kitchen. He knew that when he was helping, he would be successful with all the different kinds of pancakes. Timmy's mom was so proud of him for being such a smart boy.
+After they finished pancaking, Timmy's mom said, "Let's go now, Timmy. Your birthday is starting soon." Timmy was so happy and couldn't wait to have fun with his friends.
+
+step 21250: train loss 0.3731, val loss 0.3703
+Once upon a time, there was a small fair girl named Abigail. She was three years old and loved to play with her toys. One day, she opened the big shelf in the living room and she found a special toy. She was so excited and her mommy took her to the toy store to buy it.
+Abigail looked around to make sure nobody might look in the shelf. She saw a special toy that was a small ball. She wanted it right away, so she asked her mommy to buy it.
+But her mommy said no. She said that the toy was too small for Abigail to play with and that she had to share it with her friends. Abigail was so sad and she began to cry.
+From that day on, Abigail never shared her special toy with her friends. She learned that she should always be careful and not clung around at her toys. She was very sad and cried even more.
+The end.
+
+step 21500: train loss 0.3727, val loss 0.3759
+Once there was a girl named Emily who loved to play with her friends. Every day she would hold her favourite toy car and drive it around the garden.
+One day, when Emily's mom was checking the garden, she saw a man in a funny suit. He was laughing and telling jokes. Emily wanted to talk to the man and asked her if she could tell him a joke.
+The man said the joke was funny, and Emily laughed and laughed. The man smiled and gave her a big hug. Emily was so happy that she got to talk to the man - she had a lot of fun!
+
+step 21750: train loss 0.3742, val loss 0.3745
+Once upon a time, there was a girl named Lily. She loved to play with her dolls and eat sweet treats. One day, her mom gave her a gift - a shiny necklace with sparkly stones. Lily was so happy and put it on right away.
+But when she went outside to play, she accidentally broke the necklace. She felt sad and didn't know what to do. Her friend Timmy saw her sad face and asked what happened. Lily told him about the broken necklace.
+Timmy said, "Don't worry, Lily. We can buy a new one." So they went to the store and bought a new necklace. Lily was so happy and put it on right away. She said to Timmy, "Thank you for being so understanding when I promise to be more careful next time."
+
+step 22000: train loss 0.3757, val loss 0.3724
+Once upon a time, there was a little girl named Lily. She loved to play outside in the sunshine. One day, she had an idea to make a sandwich for her friend's birthday party. She got a big bowl and a sausage and put them on the sandwich. Then, she got a little cheese and started to mix it with some butter. It was hard work, but she did it. When she was done, she took a big bite and it was the best sandwich she had ever eaten. Her friend was so happy and surprised. Lily felt happy too, knowing that she could make her friend happy in some work. The end.
+
+step 22250: train loss 0.3714, val loss 0.3747
+Once upon a time, there was a little girl called Sarah. She liked to explore the world around her. One day, Sarah was walking around the park when she saw something shiny in the grass. She bent down to pick it up. She couldn't believe her luck! It was a beautiful mint. She held it in her hands and laughed. She thought it was the most beautiful thing she ever saw.
+Sarah quickly ran home to show her mother the mint. "Look at this!" she shouted, happily. Her mother smiled and said, "Oh, that is a beautiful mint, Sarah. You can keep it but you must be very careful with it."
+So Sarah kept the mint in her pocket and kept it safe in her room. Every day, she was careful to take the mint out and look at it and smile. Even though something behind the mint was a pretty mint, Sarah knew it was special and could bring joy to her life.
+
+step 22500: train loss 0.3706, val loss 0.3710
+Once upon a time there was a brave girl. She loved playing with her toys and looking at the stories. One day she wanted to go outside and explore a new place so she put on her shoes and went out.
+The girl saw some pretty flowers in the garden. They were pink and pretty. She welcomed them as a group of friends. She welcomed them around. The girl could feel the pretty pink flowers on her face.
+The girl was always enthusiastic about exploring. She loved going outside and seeing the flowers bloom. She also loved looking at the pretty flowers, but she knew she could explore too.
+The girl had a lot of fun discovering new things. She was happy to welcome every cogue and creature there. She kept her special pink little treasures on a sunny day.
+
+step 22750: train loss 0.3768, val loss 0.3760
+Once upon a time, there was a little girl named Lily. Lily loved to eat ice cream. She would eat it every day after school. One day, Lily's friend, Timmy, came over to play. They wanted to eat the ice cream together.
+Lily said, "I will eat the ice cream by myself, but I need to save some for later." Timmy said, "You can pass it back if you want." Lily passed the cream to Timmy and they both shared it. It was sweet and they both liked it after sharing it.
+After the ice cream, Lily's mom came into the room and saw them fighting. She said, "Why are you fighting? You are both being wealthy and sharing the cream. That's not nice!" Lily and Timmy felt bad and said sorry. They helped to save some ice cream and then enjoy it all by themself. From that day on, they always shared the ice cream and had fun together.
+
+step 23000: train loss 0.3717, val loss 0.3726
+Once upon a time, there was a man who lived on a ranch. He had a big red barn with a lot of animals inside. One day, a little girl came to the farm with her teddy bear and accidentally threw a ball on the ranch. The teddy bear got supplied and the little girl was very upset.
+The farmer saw the little girl was upset and asked her what happened. The little girl said she was scared of the farmer's carelessness. The farmer decided to help her, but he warned her to be careful and not let anyone throw the ball.
+The little girl promised to be more careful, but it was too late. The farmer had woken up and caused trouble. The farmer was very angry and wouldn't let anyone throw any animals in his ranch. The little girl was very sad and cried a lot. She learned that she should always be careful and not let anyone throw things on her ranch.
+
+step 23250: train loss 0.3679, val loss 0.3719
+Once upon a time, there was an enormous barn. Inside the barn, there was a rabbit who had a problem. The barn was too big for the rabbit's home. The rabbit's problem was small and couldn't fit in.
+The rabbit was very sad and confused. He said, "How can I make my home fit?"
+Then he had an idea. He began to design a new home with smaller barn pieces. Then he used some animals to help him put the new space in the barn. After a while, the barn was finished.
+When the rabbit saw it, he was so happy! He hopped around in it. He said, "This is the best home ever!"
+The rabbit had an enormous problem and he was happy with its new home.
+Traceback (most recent call last):
+  File "/workspace/tqdm_training_768b.py", line 437, in <module>
+    scaler.scale(loss).backward()
+  File "/usr/local/lib/python3.10/dist-packages/torch/_tensor.py", line 487, in backward
+    torch.autograd.backward(
+  File "/usr/local/lib/python3.10/dist-packages/torch/autograd/__init__.py", line 200, in backward
+    Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
+KeyboardInterrupt