For updates follow @ShuaiwenCui on Linkedin and Twitter

Eureka!

Markov Decision Process (MDP)

English
简体中文

Initializing search

Shuaiwen-Cui/Infinity

HOME
MATH
CS
CODING
EMBEDDED-SYS
DSP
PERCEPTION
CONTROL
ACTUATION
IOT
CLOUD
AI
SHM
DEV
RESEARCH
PROJECT

Eureka!

Shuaiwen-Cui/Infinity

HOME
HOME
- ABOUT
- SPONSORSHIP
MATH
MATH
CS
CS
CODING
CODING
- CODING
- CODING-ENV
- COMMAND-LINE
- SHELL
- ROOKIE 🎯🏆
  ROOKIE 🎯🏆
  - RUNOOB 🎯
    RUNOOB 🎯
    
    ROOKIE
    
    C
    
    C++
    
    PYTHON
    
    SQL
- C/C++ 🎯
  C/C++ 🎯
  - C
  - C-NOTES
  - C++
  - C++-NOTES
    C++-NOTES
    
    C++ Language Study Notes
    
    CH01
    
    CH02
    
    CH03
    
    CH04
  - MAKE-SERIES
- PYTHON 🎯
  PYTHON 🎯
  - PYTHON
  - ROADMAP
- MICROPYTHON
- HTML/CSS/JS
  HTML/CSS/JS
  - HTML
  - CSS
  - JAVASCRIPT
- WEB-DEV
  WEB-DEV
- DATABASE 🎯
  DATABASE 🎯
  - RDBMS
    RDBMS
    
    MYSQL
    
    POSTGRESQL 🎯
  - NOSQL
    NOSQL
    
    MONGODB 🎯
  - TSDB
    TSDB
    
    INFLUXDB 🎯
    
    TIMESCALEDB 🎯
    
    TDENGINE
    
    IOTDB
  - GRAPHDB
    GRAPHDB
    
    NEO4J 🎯
EMBEDDED-SYS
EMBEDDED-SYS
- Embedded Systems
- THEORY
  THEORY
  - ELECTRONICS
  - CIRCUITS
  - SIGNAL-SYSTEM
  - FREERTOS
  - LINUX
- BASICS 🎯
  BASICS 🎯
  - EMBED-BASICS
    EMBED-BASICS
    
    Embedded Systems Basics
    
    JUST
    
    YOUNGTALK
    
    EMBEDFIRE
    
    ALIENTEK
    
    DIGIKEY
    
    STM32CUBE-DEV 🎯
    
    REFERENCE
- SIMULATION
  SIMULATION
  - RENODE
  - WOKWI
- DEVKIT 🎯
  DEVKIT 🎯
  - ARDUINO
  - STM32
    STM32
    
    STM32
    
    STM32H743IIT
    
    STM32MP157
  - ESP32
  - RASPBERRYPI
  - JETSON
- IDE 🎯
  IDE 🎯
  - IDE for Embedded Systems
  - MYSETUP 🎯
  - KEIL 🎯
    KEIL 🎯
    
    Keil IDE
    
    OFFICIAL-GUIDE-MDK4
    OFFICIAL-GUIDE-MDK4
    
    KEIL MDK4 Guide 🎯✅🏆
    
    OFFICIAL-GUIDE-MDK5
    OFFICIAL-GUIDE-MDK5
    
    PREFACE
    
    MDK-INTRODUCTION
    
    CMSIS
    
    SOFTWARE-COMPONENTS
    
    CREATE-APP
    
    DEBUG-APP
    
    MDK-MIDDLEWARE
    
    MDK6
  - STM32CUBE 🎯
  - PLATFORMIO 🎯
- DEV-FRAMEWORK
  DEV-FRAMEWORK
- USEFUL-LIB 🎯
DSP
DSP
- Digital Signal Processing
- WAVELET-TRANSFORM 🎯
- INDEPENDENT-COMPONENT-ANALYSES 🎯
- NOTE-DSP-STUFF 🎯
  NOTE-DSP-STUFF 🎯
  - TIME-FREQ-ANA 🎯
    TIME-FREQ-ANA 🎯
    
    CH01
    
    CH02
    
    CH03
    
    CH04
    
    CH05
    
    CH06
    
    CH07
    
    CH08
    
    CH09
    
    CH10
    
    CH11
    
    CH12
    
    CH13
    
    CH14
    
    CH15
    
    CH16
    
    CH17
    
    CH18
  - EMD 🎯
    EMD 🎯
    
    EMD-BASICS
    
    IMF
    
    EMD-MATLAB
    
    HILBERT-HUANG-TRANSFORM
    
    HILBERT-ANA-SERIES
    
    EEMD
    
    CEEMD
    
    CEEMDAN
    
    VMD 🎯
    
    ICEEMDAN
    
    LMD
    
    EWT
    
    DWT 🎯
    
    WPT 🎯
PERCEPTION
PERCEPTION
- Perception
- SENSORS-CIVIL-ENGINEERING
CONTROL
CONTROL
- Control
ACTUATION
ACTUATION
- Actuation
- ROS 🎯
  ROS 🎯
  - Robotic Operating System (ROS)
  - OFFICIAL-GUIDE
    OFFICIAL-GUIDE
    
    INSTALLATION
    
    DISTRIBUTION
    
    TUTORIALS
    TUTORIALS
    
    CLI-TOOLS
    
    CLIENT-LIBRARIES
- HANDSON-ROS
  HANDSON-ROS
  - HANDSON-ROS
  - P1-GET-STARTED
IOT
IOT
- Internet of Things
- WSN 🎯
  WSN 🎯
  - Wireless Sensor Network (WSN)
- MQTT
  MQTT
- HOME-ASSISTANT
CLOUD
CLOUD
- Cloud Techs
- CLOUD-TECH 🎯
- HANDS-ON 🎯
  HANDS-ON 🎯
AI
AI
- BASICS 🎯
- FRAMEWORKS 🎯
- GAUSSIAN-PROCESS 🎯
- LNN
- MLP
- CNN
- RNN
- TRANSFORMER
- GNN 🎯
- GAN
- RL 🎯
  RL 🎯
- BO 🎯
- FL 🎯
- MULTI-AGENT 🎯
- TL 🎯
- NLP
- CV 🎯
- NOTE-D2L 🎯
  NOTE-D2L 🎯
SHM
SHM
- Structural Health Monitoring
- STRUCTURAL-DYNAMICS 🎯
  STRUCTURAL-DYNAMICS 🎯
  - STRUCTURAL DYANMICS
  - RESPONSE-CALCULATION
- NSEL-REPORT
DEV
DEV
- Development
- DEVENV
  DEVENV
  - LATEX
  - REMOTE-CONTROL
    REMOTE-CONTROL
    
    Remote Control
    
    RUSTDESK
    
    VSCODE-REMOTE-SSH
  - CLOUD-SYNC
  - GIT
  - GITHUB
  - DOCKER
  - EMBEDDED-SYS-DEV
  - LINUX
    LINUX
    
    UBUNTU
- GADGETS
  GADGETS
  - SERIAL-ASSISTANT
  - CHARACTER-EXTRACTION
- STM32-DEV-BOARDS
- STM32-DEV-REF
- ESP32-DEV-BOARDS
- ESP32-DEV-REF
- MCU-SYS 🎯
  MCU-SYS 🎯
  - MICRO CONTROLLER UNIT SYSTEM
- MPU-SYS 🎯
  MPU-SYS 🎯
  - MICRO PROCESS UNIT SYSTEM
- XNODE 🎯
  XNODE 🎯
  - XNODE-DOCS
  - BASIC-VERSION
- FRONT-END
- BACK-END
- VISUALIZATION
  VISUALIZATION
  - WEB-BASED
  - CLIENT-BASED
RESEARCH
RESEARCH
- NODE 🎯
  NODE 🎯
  - MCU-NODE-STM32H743 🎯
  - MCU-NODE-ESP32S3
- SYSTEM 🎯
PROJECT
PROJECT
- Projects
- TECH-BLOG
- WAREHOUSE
- EMBEDDED-DEV
- TINYSHM

Markov Decision Process (MDP)

Please refer to the Chinese version.

Was this page helpful?

Thanks for your feedback!

Thanks for your feedback! Help us improve this page by using our feedback form.