piecrust2: piecrust/data/base.py annotate

annotate piecrust/data/base.py @ 411:e7b865f8f335

bake: Enable multiprocess baking. Baking is now done by running a worker per CPU, and sending jobs to them. This changes several things across the codebase: * Ability to not cache things related to pages other than the 'main' page (i.e. the page at the bottom of the execution stack). * Decouple the baking process from the bake records, so only the main process keeps track (and modifies) the bake record. * Remove the need for 'batch page getters' and loading a page directly from the page factories. There are various smaller changes too included here, including support for scope performance timers that are saved with the bake record and can be printed out to the console. Yes I got carried away. For testing, the in-memory 'mock' file-system doesn't work anymore, since we're spawning processes, so this is replaced by a 'tmpfs' file-system which is saved in temporary files on disk and deleted after tests have run.

author	Ludovic Chabant <ludovic@chabant.com>
date	Fri, 12 Jun 2015 17:09:19 -0700
parents	fd8e39254da0
children	0e9a94b7fdfa

rev	line source
369 4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	1 import copy
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	2 import time
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	3 import logging
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	4 from piecrust.data.assetor import Assetor
329 422052d2e978 internal: Try handling URLs in a consistent way. Ludovic Chabant <ludovic@chabant.com> parents: 256 diff changeset	5 from piecrust.uriutil import split_uri
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	6
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	7
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	8 logger = logging.getLogger(__name__)
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	9
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	10
381 4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	11 class LazyPageConfigLoaderHasNoValue(Exception):
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	12 """ An exception that can be returned when a loader for `LazyPageConfig`
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	13 can't return any value.
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	14 """
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	15 pass
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	16
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	17
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	18 class LazyPageConfigData(object):
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	19 """ An object that represents the configuration header of a page,
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	20 but also allows for additional data. It's meant to be exposed
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	21 to the templating system.
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	22 """
12 30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	23 debug_render = []
408 fd8e39254da0 debug: Better debug info output for iterators, providers, and linkers. Ludovic Chabant <ludovic@chabant.com> parents: 392 diff changeset	24 debug_render_invoke = []
12 30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	25 debug_render_dynamic = ['_debugRenderKeys']
408 fd8e39254da0 debug: Better debug info output for iterators, providers, and linkers. Ludovic Chabant <ludovic@chabant.com> parents: 392 diff changeset	26 debug_render_invoke_dynamic = ['_debugRenderKeys']
12 30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	27
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	28 def __init__(self, page):
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	29 self._page = page
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	30 self._values = None
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	31 self._loaders = None
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	32
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	33 @property
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	34 def page(self):
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	35 return self._page
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	36
226 e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	37 def get(self, name):
e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	38 try:
e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	39 return self._getValue(name)
381 4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	40 except LazyPageConfigLoaderHasNoValue:
226 e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	41 return None
e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	42
12 30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	43 def __getattr__(self, name):
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	44 try:
226 e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	45 return self._getValue(name)
381 4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	46 except LazyPageConfigLoaderHasNoValue:
12 30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	47 raise AttributeError
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	48
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	49 def __getitem__(self, name):
381 4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	50 try:
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	51 return self._getValue(name)
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	52 except LazyPageConfigLoaderHasNoValue:
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	53 raise KeyError
12 30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	54
226 e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	55 def _getValue(self, name):
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	56 self._load()
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	57
381 4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	58 if name in self._values:
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	59 return self._values[name]
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	60
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	61 if self._loaders:
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	62 loader = self._loaders.get(name)
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	63 if loader is not None:
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	64 try:
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	65 self._values[name] = loader(self, name)
381 4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	66 except LazyPageConfigLoaderHasNoValue:
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	67 raise
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	68 except Exception as ex:
158 1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	69 raise Exception(
1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	70 "Error while loading attribute '%s' for: %s" %
1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	71 (name, self._page.rel_path)) from ex
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	72
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	73 # We need to double-check `_loaders` here because
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	74 # the loader could have removed all loaders, which
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	75 # would set this back to `None`.
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	76 if self._loaders is not None:
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	77 del self._loaders[name]
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	78 if len(self._loaders) == 0:
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	79 self._loaders = None
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	80
381 4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	81 else:
236 eaf18442bff8 internal: Add support for "wildcard" loader in `LazyPageConfigData`. Ludovic Chabant <ludovic@chabant.com> parents: 228 diff changeset	82 loader = self._loaders.get('*')
eaf18442bff8 internal: Add support for "wildcard" loader in `LazyPageConfigData`. Ludovic Chabant <ludovic@chabant.com> parents: 228 diff changeset	83 if loader is not None:
eaf18442bff8 internal: Add support for "wildcard" loader in `LazyPageConfigData`. Ludovic Chabant <ludovic@chabant.com> parents: 228 diff changeset	84 try:
eaf18442bff8 internal: Add support for "wildcard" loader in `LazyPageConfigData`. Ludovic Chabant <ludovic@chabant.com> parents: 228 diff changeset	85 self._values[name] = loader(self, name)
381 4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	86 except LazyPageConfigLoaderHasNoValue:
4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	87 raise
236 eaf18442bff8 internal: Add support for "wildcard" loader in `LazyPageConfigData`. Ludovic Chabant <ludovic@chabant.com> parents: 228 diff changeset	88 except Exception as ex:
eaf18442bff8 internal: Add support for "wildcard" loader in `LazyPageConfigData`. Ludovic Chabant <ludovic@chabant.com> parents: 228 diff changeset	89 raise Exception(
381 4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	90 "Error while loading attribute '%s' for: %s" %
236 eaf18442bff8 internal: Add support for "wildcard" loader in `LazyPageConfigData`. Ludovic Chabant <ludovic@chabant.com> parents: 228 diff changeset	91 (name, self._page.rel_path)) from ex
381 4c9eab0e283b data: Fix problems with using non-existing metadata on a linked page. Ludovic Chabant <ludovic@chabant.com> parents: 369 diff changeset	92 # We always keep the wildcard loader in the loaders list.
236 eaf18442bff8 internal: Add support for "wildcard" loader in `LazyPageConfigData`. Ludovic Chabant <ludovic@chabant.com> parents: 228 diff changeset	93
392 923a9b96411d data: Fix regression bug with accessing page metadata that doesn't exist. Ludovic Chabant <ludovic@chabant.com> parents: 381 diff changeset	94 if name not in self._values:
923a9b96411d data: Fix regression bug with accessing page metadata that doesn't exist. Ludovic Chabant <ludovic@chabant.com> parents: 381 diff changeset	95 raise LazyPageConfigLoaderHasNoValue()
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	96 return self._values[name]
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	97
226 e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	98 def _setValue(self, name, value):
e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	99 if self._values is None:
e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	100 raise Exception("Can't call _setValue before this data has been "
e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	101 "loaded")
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	102 self._values[name] = value
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	103
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	104 def mapLoader(self, attr_name, loader):
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	105 if loader is None:
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	106 if self._loaders is None or attr_name not in self._loaders:
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	107 return
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	108 del self._loaders[attr_name]
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	109 if len(self._loaders) == 0:
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	110 self._loaders = None
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	111 return
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	112
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	113 if self._loaders is None:
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	114 self._loaders = {}
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	115 if attr_name in self._loaders:
158 1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	116 raise Exception(
1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	117 "A loader has already been mapped for: %s" % attr_name)
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	118 self._loaders[attr_name] = loader
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	119
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	120 def _load(self):
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	121 if self._values is not None:
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	122 return
369 4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	123 self._values = self._page.config.getDeepcopy(self._page.app.debug)
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	124 try:
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	125 self._loadCustom()
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	126 except Exception as ex:
158 1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	127 raise Exception(
1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	128 "Error while loading data for: %s" %
1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	129 self._page.rel_path) from ex
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	130
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	131 def _loadCustom(self):
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	132 pass
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	133
12 30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	134 def _debugRenderKeys(self):
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	135 self._load()
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	136 keys = set(self._values.keys())
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	137 if self._loaders:
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	138 keys \|= set(self._loaders.keys())
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	139 return list(keys)
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	140
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	141
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	142 class PaginationData(LazyPageConfigData):
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	143 def __init__(self, page):
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	144 super(PaginationData, self).__init__(page)
369 4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	145 self._route = None
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	146 self._route_metadata = None
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	147
6 f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	148 def _get_uri(self):
f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	149 page = self._page
369 4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	150 if self._route is None:
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	151 # TODO: this is not quite correct, as we're missing parts of the
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	152 # route metadata if the current page is a taxonomy page.
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	153 self._route = page.app.getRoute(page.source.name,
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	154 page.source_metadata)
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	155 self._route_metadata = copy.deepcopy(page.source_metadata)
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	156 if self._route is None:
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	157 raise Exception("Can't get route for page: %s" % page.path)
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	158 return self._route.getUri(self._route_metadata, provider=page)
6 f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	159
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	160 def _loadCustom(self):
6 f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	161 page_url = self._get_uri()
329 422052d2e978 internal: Try handling URLs in a consistent way. Ludovic Chabant <ludovic@chabant.com> parents: 256 diff changeset	162 _, slug = split_uri(self.page.app, page_url)
226 e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	163 self._setValue('url', page_url)
329 422052d2e978 internal: Try handling URLs in a consistent way. Ludovic Chabant <ludovic@chabant.com> parents: 256 diff changeset	164 self._setValue('slug', slug)
226 e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	165 self._setValue(
158 1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	166 'timestamp',
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	167 time.mktime(self.page.datetime.timetuple()))
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	168 date_format = self.page.app.config.get('site/date_format')
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	169 if date_format:
226 e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	170 self._setValue('date', self.page.datetime.strftime(date_format))
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	171
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	172 assetor = Assetor(self.page, page_url)
226 e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	173 self._setValue('assets', assetor)
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	174
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	175 segment_names = self.page.config.get('segments')
f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	176 for name in segment_names:
6 f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	177 self.mapLoader(name, self._load_rendered_segment)
f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	178
f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	179 def _load_rendered_segment(self, data, name):
12 30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	180 do_render = True
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	181 eis = self._page.app.env.exec_info_stack
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	182 if eis is not None and eis.hasPage(self._page):
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	183 # This is the pagination data for the page that is currently
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	184 # being rendered! Inception! But this is possible... so just
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	185 # prevent infinite recursion.
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	186 do_render = False
3 f485ba500df3 Gigantic change to basically make PieCrust 2 vaguely functional. Ludovic Chabant <ludovic@chabant.com> parents: diff changeset	187
6 f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	188 assert self is data
12 30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	189
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	190 if do_render:
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	191 uri = self._get_uri()
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	192 try:
158 1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	193 from piecrust.rendering import (
369 4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	194 QualifiedPage, PageRenderingContext,
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	195 render_page_segments)
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	196 qp = QualifiedPage(self._page, self._route,
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	197 self._route_metadata)
4b1019bb2533 serve: Giant refactor to change how we handle data when serving pages. Ludovic Chabant <ludovic@chabant.com> parents: 329 diff changeset	198 ctx = PageRenderingContext(qp)
12 30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	199 segs = render_page_segments(ctx)
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	200 except Exception as e:
158 1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	201 raise Exception(
1187739e5a19 Fix some indentation and line lengths. Ludovic Chabant <ludovic@chabant.com> parents: 147 diff changeset	202 "Error rendering segments for '%s'" % uri) from e
12 30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	203 else:
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	204 segs = {}
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	205 for name in self.page.config.get('segments'):
30a42341cfa8 Define page slugs properly, avoid recursions with debug data. Ludovic Chabant <ludovic@chabant.com> parents: 6 diff changeset	206 segs[name] = "<unavailable: current page>"
6 f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	207
f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	208 for k, v in segs.items():
f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	209 self.mapLoader(k, None)
226 e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	210 self._setValue(k, v)
6 f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	211
f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	212 if 'content.abstract' in segs:
226 e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	213 self._setValue('content', segs['content.abstract'])
e9dc18a275ff data: Add ability for `IPaginationSource`s to specify how to get settings. Ludovic Chabant <ludovic@chabant.com> parents: 158 diff changeset	214 self._setValue('has_more', True)
6 f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	215 if name == 'content':
f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	216 return segs['content.abstract']
f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	217
f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	218 return segs[name]
f5ca5c5bed85 More Python 3 fixes, modularization, and new unit tests. Ludovic Chabant <ludovic@chabant.com> parents: 5 diff changeset	219

Mercurial > piecrust2

annotate piecrust/data/base.py @ 411:e7b865f8f335