aboutsummaryrefslogtreecommitdiffstats
path: root/xen/include/asm-x86/x86_64
Commit message (Collapse)AuthorAgeFilesLines
* x86: move struct bug_frame instances out of lineJan Beulich2013-08-231-11/+0
| | | | | | | | | | | | | | Just like Linux did many years ago, move them into a separate (data) section, such that they no longer pollute instruction caches and TLBs. Assertion frames, requiring two pointers to be stored, occupy two slots in the array, with the second slot mimicking a frame the location pointer of which doesn't match any address within .text or .init.text (it effectively points back to the slot itself, which - being in a data section - can't be reached by non-buggy execution). Signed-off-by: Jan Beulich <jbeulich@suse.com> Acked-by: Keir Fraser <keir@xen.org>
* x86: rework hypercall argument translation area setupJan Beulich2013-02-281-3/+2
| | | | | | | | | | | | | | ... using the new per-domain mapping management functions, adding destroy_perdomain_mapping() to the previously introduced pair. Rather than using an order-1 Xen heap allocation, use (currently 2) individual domain heap pages to populate space in the per-domain mapping area. Also fix a benign off-by-one mistake in is_compat_arg_xlat_range(). Signed-off-by: Jan Beulich <jbeulich@suse.com> Acked-by: Keir Fraser <keir@xen.org>
* Fix emacs local variable block to use correct C style variable.David Vrabel2013-02-212-2/+2
| | | | | | | The emacs variable to set the C style from a local variable block is c-file-style, not c-set-style. Signed-off-by: David Vrabel <david.vrabel@citrix.com
* x86: frame table related improvementsJan Beulich2012-12-111-2/+2
| | | | | | | | | | | | | | | - fix super page frame table setup for memory hotplug case (should create full table, or else the hotplug code would need to do the necessary table population) - simplify super page frame table setup (can re-use frame table setup code) - slightly streamline frame table setup code - fix (tighten) a BUG_ON() and an ASSERT() condition - fix spage <-> pdx conversion macros (they had no users so far, and hence no-one noticed how broken they were) Signed-off-by: Jan Beulich <jbeulich@suse.com> Acked-by: Keir Fraser <keir@xen.org>
* x86: save/restore only partial register state where possibleJan Beulich2012-10-301-4/+113
| | | | | | | | | | | | | | | | | | | | | | | | ... and make restore conditional not only upon having saved the state, but also upon whether saved state was actually modified (and register values are known to have been preserved). Note that RBP is unconditionally considered a volatile register (i.e. irrespective of CONFIG_FRAME_POINTER), since the RBP handling would become overly complicated due to the need to save/restore it on the compat mode hypercall path [6th argument]. Note further that for compat mode code paths, saving/restoring R8...R15 is entirely unnecessary - we don't allow those guests to enter 64-bit mode, and hence they have no way of seeing these registers' contents (and there consequently also is no information leak, except if the context saving domctl would be considered such). Finally, note that this may not properly deal with gdbstub's needs, yet (but if so, I can't really suggest adjustments, as I don't know that code). Signed-off-by: Jan Beulich <jbeulich@suse.com> Acked-by: Keir Fraser <keir@xen.org>
* x86: use MOV instead of PUSH/POP when saving/restoring register stateJan Beulich2012-10-301-36/+45
| | | | | Signed-off-by: Jan Beulich <jbeulich@suse.com> Acked-by: Keir Fraser <keir@xen.org>
* x86: clean up interrupt stub generationJan Beulich2012-09-261-8/+1
| | | | | | | | | | | | Apart from moving some code that is only used here from the header file to the actual source one, this also - moves interrupt[] into .init.data, - prevents generating (unused) stubs for vectors below FIRST_DYNAMIC_VECTOR, and - shortens and sanitizes the names of the stubs. Signed-off-by: Jan Beulich <jbeulich@suse.com> Acked-by: Keir Fraser <keir@xen.org>
* x86: enhance rsp-relative calculationsJan Beulich2012-09-261-8/+0
| | | | | | | | | | The use of "or" in GET_CPUINFO_FIELD so far wasn't ideal, as it doesn't lend itself to folding this operation with a possibly subsequent one (e.g. the well known mov+add=lea conversion). Split out the sub- operations, and shorten assembly code slightly with this. Signed-off-by: Jan Beulich <jbeulich@suse.com> Acked-by: Keir Fraser <keir@xen.org>
* x86_64: fix naming of rflags in elf regset structureAndrew Cooper2012-05-101-2/+2
| | | | | | | | | 'pushfq' pushes rflags, not eflags. Fix up naming of the structure. No functional change. Signed-off-by: Andrew Cooper <andrew.cooper3@citrix.com> Committed-by: Keir Fraser <keir@xen.org>
* x86: All vectored interrupts go through do_IRQ().Keir Fraser2012-03-301-13/+0
| | | | Signed-off-by: Keir Fraser <keir@xen.org>
* x86: Make asmlinkage explicitly a no-op, and avoid usage in arch/x86Keir Fraser2012-01-151-1/+1
| | | | Signed-off-by: Keir Fraser <keir@xen.org>
* Revert 24283:3bc4dfb54666Tim Deegan2011-12-011-5/+0
| | | | | | This fixes the 32-bit build Signed-off-by: Tim Deegan <tim@xen.org>
* x86: Add conversion from a xen map to an mfnAndres Lagar-Cavilla2011-12-011-0/+5
| | | | | | | | | This conversion is a trivial invocation of virt_to_mfn in 64 bits. In 32 bits it uses the linear_map. Signed-off-by: Andres Lagar-Cavilla <andres@lagarcavilla.org> Acked-by: Tim Deegan <tim@xen.org> Committed-by: Tim Deegan <tim@xen.org>
* atomic: Define {read,write}_atomic() for reading/writing memory atomically.Keir Fraser2011-11-251-3/+3
| | | | Signed-off-by: Keir Fraser <keir@xen.org>
* x86-64/EFI: 2.0 header extensionsJan Beulich2011-09-171-1/+16
| | | | | | | Updates from gnu-efi 3.0m. UEFI 2.0 runtime services additions taken from EDK 1.06. Signed-off-by: Jan Beulich <jbeulich@suse.com>
* x86-64: Fix off-by-one error in __addr_ok() macroKeir Fraser2011-08-311-1/+1
| | | | | Signed-off-by: Laszlo Ersek <lersek@redhat.com> Signed-off-by: Keir Fraser <keir@xen.org>
* x86-64: properly handle alias mappings beyond _endJan Beulich2011-07-141-0/+2
| | | | | | | | | | | Changeset 19632:b0966b6f5180 wasn't really complete: The Xen image mapping doesn't end at _end, but a full 16Mb gets mapped during boot (and never got unmapped so far), hence all of this space was subject to alias mappings when it comes to cache attribute changes. Unmap all full large pages between _end and the 16Mb boundary, and include all other pages beyond _end when checking for aliases. Signed-off-by: Jan Beulich <jbeulich@novell.com>
* x86-64: EFI header filesJan Beulich2011-06-281-0/+276
| | | | | | Taken from gnu-efi-3.0k (slightly edited). Signed-off-by: Jan Beulich <jbeulich@novell.com>
* x86-64: fix incorrect assertion in __maddr_to_virt()Jan Beulich2011-06-151-1/+1
| | | | | | | | When memory map sparseness reduction is in use, machine address ranges can't validly be compared directly against the total size of the direct mapping range. Signed-off-by: Jan Beulich <jbeulich@novell.com>
* x86/mm/p2m: little fixes and tidying upTim Deegan2011-06-021-0/+1
| | | | Signed-off-by: Tim Deegan <Tim.Deegan@citrix.com>
* xen: remove extern function declarations from C files.Tim Deegan2011-05-261-0/+13
| | | | | | | | Move all extern declarations into appropriate header files. This also fixes up a few places where the caller and the definition had different signatures. Signed-off-by: Tim Deegan <Tim.Deegan@citrix.com>
* x86: Remove _PAGE_NX defintiion (with implicit use of cpu_has_nx).Keir Fraser2011-03-281-18/+0
| | | | | | | | | Most users can use _PAGE_NX_BIT directly. The few genuine users in mm.c can do the cpu_has_nx check more clearly in other ways. Signed-off-by: Keir Fraser <keir@xen.org>
* x86: redefine REX64_PREFIX for clang, which doesn't like 'rex64/'.Tim Deegan2011-03-071-0/+2
| | | | | Signed-off-by: Tim Deegan <Tim.Deegan@citrix.com> Acked-by: Keir Fraser <keir@xen.org>
* x86: Do not pollute namespace with asm defns of PERFC_*.Keir Fraser2011-01-261-1/+1
| | | | | | This fixes the build with perfc=y. Signed-off-by: Keir Fraser <keir@xen.org>
* x86-64: use PC-relative exception table entriesKeir Fraser2010-12-242-4/+7
| | | | | | | | | | | | | ... thus allowing to make the entries half their current size. Rather than adjusting all instances to the new layout, abstract the construction the table entries via a macro (paralleling a similar one in recent Linux). Also change the name of the section (to allow easier detection of missed cases) and merge the final resulting output sections into .data.read_mostly. Signed-off-by: Jan Beulich <jbeulich@novell.com>
* x86: Define pte_{read,write}[_atomic] in terms of atomic_readNKeir Fraser2010-12-161-3/+3
| | | | Signed-off-by: Keir Fraser <keir@xen.org>
* x86: Define atomic_{read,write}{8,16,32,64} accessor functions.Keir Fraser2010-12-161-5/+0
| | | | | | | | | These absolutely guarantee to read/write a uint*_t with a single atomic processor instruction. Also re-define atomic_read/atomic_write (act on atomic_t) similarly. Signed-off-by: Keir Fraser <keir@xen.org>
* x86: Remove unnecessary LOCK/LOCK_PREFIX macros.Keir Fraser2010-12-161-1/+1
| | | | | | We don't support !CONFIG_SMP. Signed-off-by: Keir Fraser <keir@xen.org>
* x86_64: Make 32-bit-hypercall translate area per-vcpu.Keir Fraser2010-11-161-4/+5
| | | | | | | This is a prerequisite for allowing guest descheduling within a hypercall. Signed-off-by: Keir Fraser <keir@xen.org>
* x86: Avoid assumptions about C struct layouts from asm code.Keir Fraser2010-07-131-0/+8
| | | | | | Largely this involves avoiding assumptions about 'struct cpu_info'. Signed-off-by: Keir Fraser <keir.fraser@citrix.com>
* perfc: Fix x86_64 build with perfc_arrays=yKeir Fraser2010-06-221-1/+2
| | | | Signed-off-by: Keir Fraser <keir.fraser@citrix.com>
* x86: Speed up PV-guest superpage mappingKeir Fraser2010-05-271-0/+14
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The current version of superpage mapping takes a PGT_writable reference to every page in a superpage each time it is mapped. This is extremely slow, so slow that applications become unusable. My solution for this is to introduce a superpage table in the hypervisor, similar to the frametable structure for pages. Currently this table only has a type_info element. There are three types a superpage can have, SGT_mark, SGT_dynamic, or SGT_none. In normal operation, the first time a superpage is mapped, a PGT_writable reference is taken to each page in the superpage, and the superpage is set to type SGT_dynamic and the superpage typecount is incremented. On subsequent mappings and unmappings, only the superpage typecount changes. On the last unmap, the PGT_writable reference on each page is removed. The SGT_mark type is set and cleared through two new MMUEXT hypercalls, mark_super and unmark_super. When the hypercall is made, the superpage's type is set to SGT_mark and a PGT_writable reference is taken to its pages. On unmark, the type is cleared and the reference removed. If a page is already set to SGT_dynamic when mark_super is called, the type is changed to SGT_mark and no additional PGT_writable reference is taken. If there are still outstanding mappings of this superpage when unmark_super is called, the type is set to SGT_dynamic and the PGT_writable reference is not removed. Fast superpage mapping is only supported on 64 bit hypervisors. For 32 bit hyperviors, superpage mapping is supported but will be extremely slow. Signed-off-by: Dave McCracken <dave.mccracken@oracle.com>
* x86: Dynamically allocate percpu data area when a CPU comes online.Keir Fraser2010-05-181-1/+1
| | | | | | At the same time, the data area starts life zeroed. Signed-off-by: Keir Fraser <keir.fraser@citrix.com>
* x86: Pull dynamic memory allocation out of do_boot_cpu().Keir Fraser2010-05-181-0/+1
| | | | | | | | | | | | This has two advantages: (a) We can move the allocations to a context where we can handle failure. (b) We can implement matching deallocations on CPU offline. Only the idle vcpu structure is now not freed on CPU offline. This probably does not really matter. Signed-off-by: Keir Fraser <keir.fraser@citrix.com>
* Scattered code arrangement cleanups.Keir Fraser2009-10-072-4/+0
| | | | | | | | - remove redundant declarations - add/move prototypes to headers - move things where they belong to Signed-off-by: Christoph Egger <Christoph.Egger@amd.com>
* x86: map frame table sparselyKeir Fraser2009-09-221-5/+2
| | | | | | | | | | | | Avoid backing frame table holes with memory, when those holes are large enough to cover an exact multiple of large pages. This is based on the introduction of a bit map, where each bit represents one such range, thus allowing mfn_valid() checks to easily filter out those MFNs that now shouldn't be used to index the frame table. This allows for saving a couple of 2M pages even on "normal" systems. Signed-off-by: Jan Beulich <jbeulich@novell.com>
* x86-64: reduce range spanned by 1:1 mapping and frame table indexesKeir Fraser2009-09-221-8/+46
| | | | | | | | | | | | | | | | | Introduces a virtual space conserving transformation on the MFN thus far used to index 1:1 mapping and frame table, removing the largest range of contiguous bits (below the most significant one) which are zero for all valid MFNs from the MFN representation, to be used to index into those arrays, thereby cutting the virtual range these tables must cover approximately by half with each bit removed. Since this should account for hotpluggable memory (in order to not requiring a re-write when that gets supported), the determination of which bits are candidates for removal must not be based on the E820 information, but instead has to use the SRAT. That in turn requires a change to the ordering of steps done during early boot. Signed-off-by: Jan Beulich <jbeulich@novell.com>
* x86-64: extend manageable memory range to 5TbKeir Fraser2009-09-221-2/+2
| | | | | | | | Extend the virtual range reserved for the 1:1 mapping to cover 5Tb, and make the virtual size of the frame table gets match whatever the 1:1 table can cover. Signed-off-by: Jan Beulich <jbeulich@novell.com>
* 32on64: increase size of compat argument translation area to 2 pages.Keir Fraser2009-07-061-1/+1
| | | | | | | | | The existing single page is not quite large enough to translate a XENMEM_exchange hypercall with order=3D9. Since Linux uses MAX_CONTIG_ORDER of 9 this seems like a reasonable upper bound to support. Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
* Avoid compat_arg_xlat to be a large per-CPU objectKeir Fraser2009-07-061-1/+2
| | | | Signed-off-by: Jan Beulich <jbeulich@novell.com>
* x86: improve output resulting from sending '0' over serialKeir Fraser2009-06-161-3/+6
| | | | | | | | | | | | | | | | | | While the original logic already implied that the kernel part of the guest's address space is identical on all vCPU-s (i.e. for all guest processes), it didn't fully leverage the potential here: As long as the top page table currently active is owned by the subject domain (currently only Dom0), the stack dump can be done without extra effort. For x86-64, additionally add page table traversal so that the stack can be dumped in all cases (unless it's invalid or user space). I left the 32-bit variant of do_page_walk() unimplemented for the moment as I couldn't convince myself using map_domain_page() there is a good idea, and didn't want to introduce new fixmap entries either. Signed-off-by: Jan Beulich <jbeulich@novell.com>
* x86: unify BUG() & Co, reduce overhead on x86-64Keir Fraser2009-03-311-27/+4
| | | | | | | | | | | | | Since it's only the string pointer representations that differ between i386 and x86-64, abstract out those and make everything else shared. While touching this code, also use - proper instructions rather than a mixture of such and raw .byte/ .long/.quad data emissions, - PC-relative pointers on x86-64 to cut the amount of storage (and in particular cache space) needed for string references by half. Signed-off-by: Jan Beulich <jbeulich@novell.com>
* x86: virt_to_mfn() fixes.Keir Fraser2009-03-311-1/+7
| | | | Signed-off-by: Xiaowei Yang <xiaowei.yang@intel.com>
* x86_64: Fix handling of DIRECTMAP_VIRT_START in virt_to_maddr().Keir Fraser2009-03-201-1/+1
| | | | Signed-off-by: Xiaowei Yang <xiaowei.yang@intel.com>
* x86: unify local_irq_XXX()Keir Fraser2008-12-111-10/+0
| | | | | | | | | | | | | | | This also removes an inconsistency in that x86-64's __save_flags() had a memory clobber, while x86_32's didn't. It further adds type checking since blindly using {pop,push}{l,q} on a memory operand of unknown size bares the risk of corrupting other data. Finally, it eliminates the redundant (with local_irq_restore()) __restore_flags() macro and renames __save_flags() to local_save_flags(), making the naming consistent with Linux (again?). Signed-off-by: Jan Beulich <jbeulich@novell.com>
* x86: PV support for hugepagesKeir Fraser2008-11-051-1/+1
| | | | | | | | Hugepage support must be enabled via the hypervisor command line option "allowhugepage". There is currently no support in the tools for saving/restoring/migrating guests who use hugepages. Signed-off-by: Dave McCracken <dave.mccracken@oracle.com>
* x86: Fix GRANT_PTE_FLAGS.Keir Fraser2008-11-031-3/+0
| | | | | | | | | | | | | | | | | | Since page table entries created through e.g. GNTTABOP_map_grant_ref are being passed through adjust_guest_l1e(), they must not generally get _PAGE_USER set - this will be taken care of by adjust_guest_l1e(), and it will ensure that these don't get _PAGE_GLOBAL set inadvertently. Due to the implied security aspect here (_PAGE_GLOBAL getting set on kernel pages for x86-64), I'd like to ask that this also be applied to older maintained branches. At the same time, set _PAGE_NX for pte-s created for grants (as long as hardware supports it), since it should be only data pages that remote domains are being given access to. Signed-off-by: Jan Beulich <jbeulich@novell.com>
* x86: relax restrictions on reserved bits in L3 for 32on64 x86 guestsKeir Fraser2008-10-271-1/+1
| | | | | | | | A 32on64 guest cannot copy an existing pinned L3 entry to use as a new L3 because COMPAT_L3_DISALLOW_MASK contains bits which are added to L3 entries by adjust_guest_l3e (U/S & R/W) or by the hardware (A & D). Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
* x86: change _PAGE_GNTTABKeir Fraser2008-09-241-0/+3
| | | | | | | | | | | | | | | | | | | | | Since Linux started to use one of the 3 low available bits, _PAGE_IO needed to be moved to a different one. Not remembering about _PAGE_GNTTAB in debug hypervisors, I ended up assigning it to the same bit, which made the kernel fail on the debug hypervisor. However, rather than fixing the kernel it seems more appropriate for the hypervisor to stay away from these bits, not the least because its definition was anyway accompanied by a warning that this may be incompatible with certain OSes. While obviously the hypervisor has to use some bit (and it's therefore unavoidable that there's some risk of collision), using one of the high available bits seems to be the better choice over using one of the three low ones. Since in 32-bit mode these bits are reserved, the patch disables the functionality here. The only reasonable alternative I would see is to disable the functionality by default, but add a command line option to specify which bit to use. Signed-off-by: Jan Beulich <jbeulich@novell.com>
* 32-on-64: Fix is_compat_arg_xlat_range().Keir Fraser2008-06-131-1/+2
| | | | Signed-off-by: Keir Fraser <keir.fraser@citrix.com>
generated by cgit v1.2.3 (git 2.25.1) at 2024-06-16 04:52:01 +0000