Discrete-Time Markov Control Processes

Name: Discrete-Time Markov Control Processes
Brand: Springer Nature
SKU: 9780387945798
Availability: InStock

Discrete-Time Markov Control Processes

Brand

Springer Nature

Manufacturer

N/A

Part Number

GTIN

9780387945798

Condition

New

0 Reviews

0 Questions | 0 Answers

Product Description

This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re source management, (control of) epidemics, etc. However, most of the lit erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with "partially observable" systems) a standard approach is to transform them into equivalent "completely observable" sys tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued.

Available Colors

N/A

Available Sizes

N/A

1 Offer Price Range: $129.00 - $129.00

BEST PRICE

Single Product Purchase

$116.10

@ Link.springer.com with extra coupon Get Coupon & BUY

Price Comparison

Seller	Contact Seller	List Price	On Sale	Shipping	Best Promo	Final Price	Volume Discount	Financing	Availability	Seller's Page
BEST PRICE 1 Product Purchase @ Link.springer.com Rate Seller This functionality is for registered users only. Go to Login/Register		$129.00	$129.00		10% OFF This deals requires coupon Get Code Here your10off @ Link.springer.com Deals Ends 31/08/2025	$116.10		See Site	In stock	Visit Store