ESP32-CAM with LVGL Speech/Face Recognition IR Control

Overview

ESP_MASTER

ESPMASTER

NetFlix on UWP

This is a comprehensive project that combines the powerful computing capabilities of ESP32, with functions such as speech recognition, image recognition, GUI learning, and FFT music spectrum. It is suitable for learning image recognition algorithms and making LVGL-based UI interfaces.

功能介绍:
1、语音识别。将数字麦克风通过I2S连接到ESP32,经过esp-skainet离线语音识别,自定义语音命令词最大个数为 100
2、物体识别、文字识别(车牌识别)。基于百度智能云,将摄像头获取的RGB图像转为JPG,经过base64和urlcode编码上传到百度云后获取识别结果来显示。
3、颜色识别。可由摄像头获取的图像将RGB转为HSL判断每一个像素点,进行颜色块的识别,获取颜色块坐标。
4、家电控制。可由语音设置空调类型,也可以在设置界面设置空调种类,当前支持格力、美的、海尔空调,空调码库由IREXT提供,码库存放在flash的spiffs分区中。
5、LVGL。基于LVGL 7.6.0,10余个界面切换。
6、ADC按键。在ESP32引脚极其不够的情况下,使用一个IO口,经过电阻分压可读取三个按键的状态。
7、FFT频谱,将数字麦克风通过I2S连接到ESP32,经过软件fft获得频谱通过lvgl img显示。
8、小游戏。移植2048和贪吃蛇游戏。
9、每日鸡汤。进入每日鸡汤界面后,HTTP随机获取一句话显示。

Languages and Tools:

C C++ Python JSON Altium Designer Visual Studio Code

Software

Hardware

  • ESP32-D0WD-V3/ESP-WROVER-B
  • PSRAM : 4Mb
  • Flash : 16Mb
  • Mic on Board MSM261S4030H0
  • Three ADC Buttons in one gpio
  • IMU : MPU6050
  • SENSOR : OV2640/OV7725/OV5640/OV7670
  • ST7789 IPS 240*240 1.3`/1.54'
  • Type-c USB

GUI

Font

  • 阿里汉仪智能黑体

Pic:

Thanks

 本项目参考了较多开源项目,非常感谢以下开源作者提供了很多思路:

禁止商用

本项目开源协议为 CC-BY-NC-SA 3.0(知识共享-署名-非商业性使用-相同方式共享 3.0) 仅供个人学习使用(防止有人放到闲鱼倒卖资料)

You might also like...
A LVGL porting for Cortex-M55 running on an Arm official FPGA prototyping development board called MPS3 (AN547)
A LVGL porting for Cortex-M55 running on an Arm official FPGA prototyping development board called MPS3 (AN547)

A LVGL porting for Cortex-M55 running on an Arm official FPGA prototyping development board called MPS3 (AN547), see Figure 1. It is also possible to run the project template on an emulator called Corstone-300-FVP, which is free.

ESP-32 CAM implementation of a Bird classifier using Arduino IDE

Bird-Classifier ESP-32 CAM implementation of a Bird classifier using Arduino IDE For the file server to run, you also need to have the ESP32 SD File M

Control Heidelberg Wallbox Energy Control over WiFi using ESP8266 and configure your own local load management
Control Heidelberg Wallbox Energy Control over WiFi using ESP8266 and configure your own local load management

scroll down for English version and additional information wbec WLAN-Anbindung der Heidelberg WallBox Energy Control über ESP8266 Die Heidelberg W

Azure Outlook Command & Control (C2) - Remotely control a compromised Windows Device from your Outlook mailbox. Threat Emulation Tool for North Korean APT InkySquid / ScarCruft / APT37. TTP: Use Microsoft Graph API for C2 Operations. Automatic street light control using LDR as the sensor and an LED as an example of a street light. Performed a small simulation of an Arduino board along with LDR and LED to simulate the automatic street light control in TinkerCAD.
Budgie Control Center is a fork of GNOME Control Center for the Budgie 10 Series.

Budgie Control Center Budgie Control Center is a fork of GNOME Settings / GNOME Control Center with the intent of providing a simplified list of setti

ESP32 firmware to read and control EMS and Heatronic compatible equipment such as boilers, thermostats, solar modules, and heat pumps
ESP32 firmware to read and control EMS and Heatronic compatible equipment such as boilers, thermostats, solar modules, and heat pumps

EMS-ESP is an open-source firmware for the Espressif ESP8266 and ESP32 microcontroller that communicates with EMS (Energy Management System) based equipment from manufacturers like Bosch, Buderus, Nefit, Junkers, Worcester and Sieger.

3D printer control board based on ESP32,support 8 Driver motors.
3D printer control board based on ESP32,support 8 Driver motors.

PandaZHU use ESP32 as the mcu for 3D printer motherboard. Zhu is Chinese for bamboo it has larger memory and more powerful than normal 32bit 3D printe

Bluetooth Gateway for Phantom Remote Control based on ESP32
Bluetooth Gateway for Phantom Remote Control based on ESP32

Phantom remote control Bluetooth gateway An ESP3232 firmware for the gateway of Phantom remote control, which can push the temperature and humidity data of Phantom remote control through LAN, and also support to control Phantom remote control to send and receive IR data through LAN.

Comments
  • ubuntu-Advice 头文件包含

    ubuntu-Advice 头文件包含

    up主你好,在编译项目时遇到一个问题

    build log

    ../main/page/page_tab.c:16:10: fatal error: irtask.h: No such file or directory #include "irtask.h"

    Environment

    • ubuntu 20.04
    • esp-idf v4.4.1

    current resolve

    在文件 main/page/page_tab.c 中的16行, #include "irtask.h"

    在改写为

    #include "irTask.h"

    后编译通过,请问这样操作是正确的吗?

    opened by marktlen 0
Owner
Kevincoooool
A programmer. Wechat:xkz10617 QQ:97354734
Kevincoooool
A simple tool using PC mouse via USART to control MCU and LCD/OLED (with LVGL library), if your screen cannot be controlled by touch.

LVGL_USB_Mouse A simple tool using PC mouse via USART to control MCU and LCD/OLED (with LVGL library), if your screen cannot be controlled by touch. 如

k_ying 5 May 5, 2022
esp32 cam digital low latency fpv

esp32-cam-fpv esp32 cam digital, low latency FPV This project uses a modified esp-camera component running on an AI Thinker board to send low-latency

null 126 Dec 31, 2022
Builds and runs an exported image classification impulse on ESP32 Cam

ESP32 Cam and Edge Impulse How to run custom inference on a ESP32 cam using Edge Impulse. Material This code has been tested the AI Thinker ESP32 Cam

Edge Impulse 65 Dec 31, 2022
My humble attempt at getting tensorflow and the ESP32-CAM to cooperate

ESP32-Object-Recognition My humble attempt at getting tensorflow and the ESP32-CAM to cooperate (among other things) Notes: "Webcam_detection.py" isn'

null 13 Jun 21, 2022
ESP32-Cam mod for Voron V2

ESP32-Cam Mod For Voron V2 This is a webcam mod for Voron V2. This project is currently under development. What else you need: ESP32-CAM with ov2640/o

Vaan Ip 33 Dec 10, 2022
Tiny and cheap robot car for inspecting sewer pipes >= 125 mm. With pan servo for the ESP32-Cam module

ESP32-Cam Sewer inspection car Version 1.0.0 - work in progress Based on esp32-cam-webserver by Owen Carter. Additional Features Pan servo for the ESP

Armin 5 Nov 6, 2022
AnalogWrite for ESP32 and ESP32-S2 with LEDC PWM. Includes PWM Phase Control, DAC and Smart GPIO resource management.

analogWrite() ESP32 Installation Instructions This library was tested using using the ESP32 Arduino IDE Boards Manager installation method. Stable rel

null 36 Jan 5, 2023
ESP32-Skid-Steer - Bruder Catepillar Skid Steer model converted to RC, controlled by an ESP32 with 2 analog joysticks and a receiver that is an ESP32 on the model.

ESP32-Skid-Steer Bruder Catepillar Skid Steer model converted to RC, controlled by an ESP32 with 2 analog joysticks and a receiver that is an ESP32 on

null 6 Oct 27, 2022
M5Core2 Weather Dashboard based on LVGL.

M5Core2 Weather Dashboard Demo Based on LVGL and X-TRACK. Before compile Because CPP does not support flexible array member, you need to modify the de

M5Stack 19 Dec 12, 2022
STM32+LVGL ==> WATCH

HWatch STM32+LVGL ==> WATCH 网盘链接: 源码: 链接:https://pan.baidu.com/s/1h0YSe5Ja6y8xVL-h4-vCUg 提取码:8pxz 参考资料: 链接:https://pan.baidu.com/s/13PEog4OyJ0LQ3oz

null 67 Oct 6, 2022