Skip to content

Janak-Lal

  • Home
  • Python
    • Django
    • Pandas
    • PyTorch
    • Flask
    • streamlit
  • Reinforcement Learning
  • Blog
    • JavaScript
    • Games
  • mlops
  • About Us
Python
Ants and Bees using VGG16
February 4, 2022
Django
Django News App Part III
March 11, 2023
Django
Django News App Part I
March 9, 2023
Python
Teaching Robots to Slide Objects: TQC Reinforcement Learning on FetchSlideDense-v4
September 2, 2025
Django
A Poetry API with Django
April 5, 2023
Django
Django Image Processing Webapp Part IV
May 22, 2023
September 19, 2025

Building NanoGPT from Scratch in PyTorch: A Beginner-Friendly Guide to Transformers

building NanoGPT step by step using PyTorch.

Python 0 22 min read
September 13, 2025

U²-Net with PyTorch: Salient Object Detection and Background Removal Tutorial

Learn how to implement U²-Net with PyTorch for salient object detection and background removal. Step-by-step guide with code examples and explanations.

Python 0 23 min read
September 2, 2025

Teaching Robots to Slide Objects: TQC Reinforcement Learning on FetchSlideDense-v4

you will learn how to train a Truncated Quantile Critics (TQC) agent on the FetchSlideDense-v4 environment using Stable-Baselines3 and Gymnasium Robotics.

Python 0 12 min read
August 19, 2025

Mastering Autonomous Parking with SAC and HER: A Deep Reinforcement Learning Guide

Reinforcement Learning (RL) is revolutionizing autonomous driving, and one of the key challenges is autonomous parking—a complex task requiring precise control and decision-making. In this blog, we’ll explore how Soft Actor-Critic (SAC) combined with Hindsight Experience Replay (HER) can train an RL agent to master parking in the highway-env environment.

Python 0 7 min read
August 14, 2025

Solving the MuJoCo HumanoidStandup Task with PPO and Stable-Baselines3

We learn to solve MuJoCo HumanoidStandup problem using PPO with the help of stable baseline.

Python 0 9 min read

Categories

  • Django
  • Flask
  • Games
  • JavaScript
  • mlops
  • Pandas
  • Python
  • PyTorch
  • Reinforcement Learning
  • streamlit

Recent Posts

  • Building NanoGPT from Scratch in PyTorch: A Beginner-Friendly Guide to Transformers
  • U²-Net with PyTorch: Salient Object Detection and Background Removal Tutorial
  • Teaching Robots to Slide Objects: TQC Reinforcement Learning on FetchSlideDense-v4
  • Mastering Autonomous Parking with SAC and HER: A Deep Reinforcement Learning Guide
  • Solving the MuJoCo HumanoidStandup Task with PPO and Stable-Baselines3
  • About Us
  • Learn Python Course
  • Sample Page

Copyright ©2025 Janak-Lal . All rights reserved. Powered by WordPress & Designed by Bizberg Themes