Project Portfolio

ACI SpeechHub

Keywords: NLP, ASR, Diarization, YouTube to Doc

Try SpeechHub

ACI SpeechHub is a combination of several audio based applications developed for meeting automation, call centre automation and several other business usage. The entire ML backend was developed by me integrating models for speech recognition, speaker diarization, dialogue summarization and keyword detection.

Key Features of ACI SpeechHub:

  • Incredibly low-latency (approximately 50s for 1 hour of audio) Audio Transcription in Bengali and English languages.
  • Speaker Diarization and dialogue-style conversation generation from audio data.
  • Summarization of entire conversation.
  • Mentioned keywords detection and frequency count.
  • YouTube to PDF generation.
ACI SpeechHub

Key Technologies used in ACI SpeechHub:

  • Transformer-based (Whisper-Medium) Automatic Speech Recognition (ASR) system.

  • Flash attention 2.0 based Insanely Fast Whisper technology used for incredibly low latency transcription.

  • Integration with PyAnnote based speaker diarization for dialogue style conversation generation.

  • BERT based dialogue summarization technology.

  • Levenstein distance based Keyword detection system.

  • Integration of FastAPI based devOps system and SQL based database system for seamless usage.

  • Backend language: Python 3.9, PyTorch

The code for this project can't be made public for security reasons, but can be provided with proper check. Contact me via Email if you needed.

CLICK HERE TO USE ACI SPEECHHUB

Face Recognition and Live Attendance System

Keywords: Deep Learning, Face Recognition

The face recognition based live attendance system uses IP camera in the office compound to detect faces of employees and generate automated attendance system. Each registered employee's face is detected and then the entry and exit time is written in the database. The database further can calculate total office hour spent by an employee from the recorded system.

Key technology used:

  • FaceNet architecture based face recognition system.
  • Anti spoofing system for detecting false positives.
  • Qdrant based vector database system for storing and later matching facial embeddings of employees.
  • Backend language: Python 3.8
20240606_155226
A fun image while developing face recognition system

Document Keyword Extraction for Supply Chain PO & PI Documents

Keywords: Deep Learning, Document Extraction, Prompt Engineering

Important information extraction from supply chain PO and PI documents using Google's multimodal "Gemini" model with proper prompt engineering. The problem statement was to fill in business forms by extracting several important information such as "Importer/Exporter Name", "Bank Details" etc. from supply chain documents.

Key technology used:

  • Google’s Gemini 1.5 Flash API based service.
  • Prompt Engineering by experimenting with several types of prompts.
  • Backend Language: Python 3.8
Sample Response

ACI Project HitCounter

Keywords: DevOps, Logging System. Gradio

The ACI Project HitCounter is a project developed for documentation of each project usage among the businesses. This project interrupts each API requests in the ACI servers and creates a log file. Later, the frontend reads the logfile for a comprehensive overview of each project usage with count of total project usage as well as count of each endpoint requests.

Key technology used:

  • API middleware to interrupt API requests of each projects and create logs.
  • SSH technology for server-to-server communication.
  • Gradio for frontend.
  • Backend Language: Python 3.9
ACI MIS Project HitCounter

Bangla NLP Toolkit - PyPi Package

Keywords: NLP, Deep Learning, PyPi

Package Link

BanglaNLPToolkit is a package for several classic NLP text preprocessing and augmentations for Bangla NLP tasks.

Key features:

  • Bangla Text Normalization.
    • Bangla text unicode normalization for text preprocessing using bnunicodenormalizer and csebuetnlp/normalizer.
    • Removal of punctuations or replacement of punctuations with desired sign as user desires.
  • Bangla Punctuation
    • Add punctuations to Bangla texts with no punctuations.
    • Uses deep learning based Named Entity Recognition models for accurate punctuation addition.
  • Bangla Text Augmentation
    • Text augmentation techniques for generating similar but different texts for augmenting Bangla dataset.
    • Uses paraphrasing, cross translation and masked word prediction algorithms for augmented text generation.
  • Simple Bangla Tokenizer
    • Robust simple word level tokenizer for Bangla texts.

Click here to learn more about the usage of the package, redirects to GitHub repository and documentation.

Bengali Book Genre Classification

Keywords: NLP, Deep Learning, Classification

Kaggle Link

This was a competition arranged by CUET ETE DAY 2023 on Kaggle. The problem was to classify books on 7 different genres from reviews/summaries collected from the internet. The dataset contained a mixture of Bengali and English reviews of books on all 7 of the genres. My solution to this competition involved heavy data processing and experimenting with different models to achieve the best score. I succesfully achieved the 1st Runner Up position in the competition and 3rd position in the private Leaderboard (the 1st position on the leaderboard was a fake submission from a deleted account).

Resume Classification Using Natural Language Processing

Keywords: NLP, Deep Learning, Classification

GitHub Repository

Building a resume classification system using transformer based NLP systems. The model was trained to classify resumes in several common predefined classes. I fine-tuned the XLNet base model to build the system. This was an independent project of my own in an attempt to satisfy my curiosity of NLP. The details of the project and my training process are available in the GitHub repository mentioned below.

Health Monitoring System with PPG & ECG Signal Using IoT

Keywords: Health Monitor, Early Health Warning, IoT

Project Report

By utilizing PPG and ECG sensor data, real time monitoring health condition of individuals using Arduino. The sensor data was then utilized to the cloud for early detection of diseases and warning the individual. This work is an academic project evaluated for the Biomedical Signal Processing & Instrumentation laboratory course I took during my final year of undergraduate. I got an 'A+' for successful completion of the project. A detailed report can be found in the following link.

Traffic Speed Detection System with Image Processing

Keywords: Traffic Detection, Image Processing

GitHub Repository

Detection of vehicles in traffic footage and count velocity using YOLO V2.0 based image processing system. This was my first ever project in the field of Machine Learning. Me and my group used YOLO V2.0 library to build and run the system in MATLAB environment. The project was an academic requirement for Digital Signal Processing laboratory course during my third year of undergraduate. I got an 'A+' in this course as well.

Morse Code Generator with FPGA

Keywords: Morse Code Generator, FPGA, Verilog HDL

By utilizing FPGA hardware and Verilog HDL, a system was built to convert given input to their respective Morse code. This project was an academic requirement for the Digital Logic Design Laboratory course of the 3rd year of undergraduate. I got an 'A+' in the course and the project received great appreciation from the course teachers.

Solar Powered Environmental Monitoring System with Arduino UNO

Keywords: Solar, Temperature Humidity and Gas Level Monitor, Arduino

Video Demonstration

Arduino based environmental monitoring system. The system uses solar to power itself and run automatically to detect temperature, humidity and air quality of the environment. This project was an academic requirement for the Microprocessor Laboratory course of my final year of undergraduate.

Implementation of an MQTT Based Home Automation System

Keywords: IoT, Smart Home, MQT

Project Report

IoT based system to controll home appliances with smartphone. The project was demonstrated in proteus simulation environment along with a practical implementation in one of our group-mate's own home. This project was an academic requirement.

Analysis of Three Phase Circuit with MATLAB

Keywords: Circuit Analysis, Three Phase Circuit, MATLAB Code

Project Report

Building a system which can solve complex electrical circuits and three phase circuit systems using MATLAB and build a user interface for general use. The complex circuit solver was the real challenge. The system can take input of circuit of any combination or any kind and still solve it using MATLAB codes and generate results. The user interface makes it easier to navigate. This was my first academic project, a requirement for the Numerical Methods Laboratory of my second year of undergraduate degree.