Skip to content

Janak-Lal

  • Home
  • Python
    • Django
    • Pandas
    • PyTorch
    • Flask
    • streamlit
  • Reinforcement Learning
  • ROS2
  • Blog
    • JavaScript
    • Games
    • mlops
  • About Us
Django
Blog for Poems in Django Part IV
June 4, 2023
Django
Django Admin Customization
November 25, 2023
Python
Understanding Implicit Quantile Networks in Reinforcement Learning
June 13, 2024
Python
Policy Gradient Implementation Using PyTorch
June 26, 2024
Django
Django Image Processing Webapp Part III
May 13, 2023
Python
Face Detection and Recognition with Python, OpenCV, and Deep Learning: A Step-by-Step Guide
April 12, 2025
December 23, 2025

Installing ROS 2 Humble on Ubuntu 22.04 (Jammy Jellyfish)

Installing ROS 2 Humble on Ubuntu 22.04 (Jammy Jellyfish)

ROS2 0 1 min read
September 19, 2025

Building NanoGPT from Scratch in PyTorch: A Beginner-Friendly Guide to Transformers

building NanoGPT step by step using PyTorch.

Python 0 22 min read
September 13, 2025

U²-Net with PyTorch: Salient Object Detection and Background Removal Tutorial

Learn how to implement U²-Net with PyTorch for salient object detection and background removal. Step-by-step guide with code examples and explanations.

Python 0 23 min read
September 2, 2025

Teaching Robots to Slide Objects: TQC Reinforcement Learning on FetchSlideDense-v4

you will learn how to train a Truncated Quantile Critics (TQC) agent on the FetchSlideDense-v4 environment using Stable-Baselines3 and Gymnasium Robotics.

Python 0 12 min read
August 19, 2025

Mastering Autonomous Parking with SAC and HER: A Deep Reinforcement Learning Guide

Reinforcement Learning (RL) is revolutionizing autonomous driving, and one of the key challenges is autonomous parking—a complex task requiring precise control and decision-making. In this blog, we’ll explore how Soft Actor-Critic (SAC) combined with Hindsight Experience Replay (HER) can train an RL agent to master parking in the highway-env environment.

Python 0 7 min read

Categories

  • Django
  • Flask
  • Games
  • JavaScript
  • mlops
  • Pandas
  • Python
  • PyTorch
  • Reinforcement Learning
  • ROS2
  • streamlit

Recent Posts

  • Installing ROS 2 Humble on Ubuntu 22.04 (Jammy Jellyfish)
  • Building NanoGPT from Scratch in PyTorch: A Beginner-Friendly Guide to Transformers
  • U²-Net with PyTorch: Salient Object Detection and Background Removal Tutorial
  • Teaching Robots to Slide Objects: TQC Reinforcement Learning on FetchSlideDense-v4
  • Mastering Autonomous Parking with SAC and HER: A Deep Reinforcement Learning Guide
  • About Us
  • Learn Python Course
  • Sample Page

Copyright ©2026 Janak-Lal . All rights reserved. Powered by WordPress & Designed by Bizberg Themes